datajams-lbai / datajams-evictions (public) (License: AGPLv3) (since 2020-09-01) (hash sha1)
Extracting Harris County evictions information for Houston DataJams
Clone URLs: https://rocketgit.com/user/datajams-lbai/datajams-evictions ssh://rocketgit@ssh.rocketgit.com/user/datajams-lbai/datajams-evictions git://git.rocketgit.com/user/datajams-lbai/datajams-evictions
first
List of commits:
Subject Hash Author Date (UTC)
Add some more date munging to get YYYY-MM-DD 40aaac1813b4dfa2ea2987027157cea491f81d2d Luigi Bai 2020-09-21 17:35:17
Try to abort earlier when connections fail. 32beffa93cc86e9c09101ab8637db07e8f5a2afb Luigi Bai 2020-09-21 17:34:59
Do insert before update on updateAddress in case party isn't there. Allow sqlDAO to ignore insert errors silently. 4bec38299c66cdf2cbb2317babde3c08dcd02ae1 Luigi Bai 2020-09-19 16:25:47
Allow passing in number of cases to update. ee680faa663867a52b2cbd49b68ba477f17c8cf0 Luigi Bai 2020-09-19 16:24:57
Give a heads up on how many cases will be udpated. 6624a0e47f1a2f326e4f079a93dc8beea84aae24 Luigi Bai 2020-09-18 21:37:32
Choose only Active cases or cases with NULLs to update. eadbf12cdc696dbe027578b2c352a09a2c6778b4 Luigi Bai 2020-09-18 21:37:13
Fix typo. 021fde3ca5c6697ea1c7c9cee00d4c2937fb6385 Luigi Bai 2020-09-18 21:36:36
Fix dates to YYYY-MM-DD on the way in, as much as possible. fa16c80ea14bad924f75ecc81d3cbfc4b2fe21e4 Luigi Bai 2020-09-18 21:36:20
Include some SQL scripts to update dates from the courts to YYYY-MM-DD. bde2825badffc0900955df5119107f38121eb14a Luigi Bai 2020-09-18 21:35:23
* improve date manipulation, replace moment with dayjs * (bug) Court.class extract parser now creates correct Docket and DocketedCase * don't bother with EXTRACT_HEARINGS, those are always empty * updateStatus updates status AND filed_Date 8ae2890852f5cb53c0429cc791098fee86f5b793 Luigi Bai 2020-09-18 02:49:03
Store case status and filedDate when available e0d7a3d44e4560e04133e777bdc0697bec57a8d4 Luigi Bai 2020-09-16 20:38:15
Clean up data xfer. Use TRUNCATE TABLE instead of DELETE FROM. e407788ccd1fb9ace1ca7cad4b0a1acd0189c799 Luigi Bai 2020-09-16 02:37:15
Clean up code. 3036e8ca177024179b3a6e391876121e526cd213 Luigi Bai 2020-09-16 02:36:42
Add bulkExtract importer. 0da4130e3e3a3e2e855f2ef28c4194fb6b5dfe10 Luigi Bai 2020-09-16 02:36:02
Add court related data 20f13f9ef9885794eddb2470bd57a9207dc7af20 Luigi Bai 2020-09-12 21:47:34
Try to avoid errors where information may be missing. 3410e49ba53bd7ebb417ee9bac7db1cf9e0e8808 Luigi Bai 2020-09-09 17:08:59
Don't put status information into console.log. 19dab8ff60a0256f9511391d4088c1b8f88ac3db Luigi Bai 2020-09-09 17:06:24
Add more info to README. 9708b396b887bab284e0ad2c2d996ea2db0ff4d4 Luigi Bai 2020-09-09 12:37:24
Add info to README. 79672fad423a570d7eb05c4891dfabb511db5ab3 Luigi Bai 2020-09-09 00:20:23
Fixed searchNames. Now you can load cases where you know one of the parties. 0ad812704e27341a481a6de18c88a4f38bb61700 Luigi Bai 2020-09-08 23:43:48
Commit 40aaac1813b4dfa2ea2987027157cea491f81d2d - Add some more date munging to get YYYY-MM-DD
Author: Luigi Bai
Author date (UTC): 2020-09-21 17:35
Committer name: Luigi Bai
Committer date (UTC): 2020-09-21 17:35
Parent(s): 32beffa93cc86e9c09101ab8637db07e8f5a2afb
Signer:
Signing key:
Signing status: N
Tree: b99fe1248263d4a653bbb87ba3f6600a09161e2c
File Lines added Lines deleted
lib/Case.class.js 7 5
File lib/Case.class.js changed (mode: 100644) (index e5051d1..9ef8700)
... ... function getCaseInfo(nodes, obj) {
80 80 findAndSet("Case Number:", "caseNumber", labels, obj); findAndSet("Case Number:", "caseNumber", labels, obj);
81 81 findAndSet("Filed Date:", "filedDate", labels, obj); findAndSet("Filed Date:", "filedDate", labels, obj);
82 82 findAndSet("Case Status:", "caseStatus", labels, obj); findAndSet("Case Status:", "caseStatus", labels, obj);
83 obj.filedDate=(new m(obj.filedDate).format("YYYY-MM-DD"));
83 84 }; };
84 85
85 86 function getCivilInfo(nodes, obj) { function getCivilInfo(nodes, obj) {
 
... ... function getEventInfo(nodes, obj) {
175 176
176 177 let eventList = []; let eventList = [];
177 178
178 // For each party:
179 // For each event:
179 180 events.forEach((partyDiv) => { events.forEach((partyDiv) => {
180 let party = {};
181 let event = {};
181 182
182 183 // get all the labels: // get all the labels:
183 184 let labels = du.filter(node => { let labels = du.filter(node => {
184 185 return ("span" === node.name && "value" === node.attribs.class); return ("span" === node.name && "value" === node.attribs.class);
185 186 }, partyDiv); }, partyDiv);
186 187
187 findAndSet("Event Description:", "description", labels, party);
188 findAndSet("Date Added:", "dateAdded", labels, party);
188 findAndSet("Event Description:", "description", labels, event);
189 findAndSet("Date Added:", "dateAdded", labels, event);
190 event.dateAdded=(new m(event.dateAdded).format("YYYY-MM-DD"));
189 191
190 eventList.push(party);
192 eventList.push(event);
191 193 }); });
192 194
193 195 obj.events = eventList; obj.events = eventList;
Hints:
Before first commit, do not forget to setup your git environment:
git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):
git clone https://rocketgit.com/user/datajams-lbai/datajams-evictions

Clone this repository using ssh (do not forget to upload a key first):
git clone ssh://rocketgit@ssh.rocketgit.com/user/datajams-lbai/datajams-evictions

Clone this repository using git:
git clone git://git.rocketgit.com/user/datajams-lbai/datajams-evictions

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:
... clone the repository ...
... make some changes and some commits ...
git push origin main