datajams-lbai / datajams-evictions (public) (License: AGPLv3) (since 2020-09-01) (hash sha1)
Extracting Harris County evictions information for Houston DataJams
Clone URLs: https://rocketgit.com/user/datajams-lbai/datajams-evictions ssh://rocketgit@ssh.rocketgit.com/user/datajams-lbai/datajams-evictions git://git.rocketgit.com/user/datajams-lbai/datajams-evictions
first
List of commits:
Subject Hash Author Date (UTC)
Actually care more about reaching recent filed_date cases than casenumber. Often they'll be pretty close, but casenumber will sort by precinct/place instead of filing date. 8d5f1c19cdf405281ceb9aa254c142d890da20a4 Luigi Bai 2020-09-21 17:36:26
Add some more date munging to get YYYY-MM-DD 40aaac1813b4dfa2ea2987027157cea491f81d2d Luigi Bai 2020-09-21 17:35:17
Try to abort earlier when connections fail. 32beffa93cc86e9c09101ab8637db07e8f5a2afb Luigi Bai 2020-09-21 17:34:59
Do insert before update on updateAddress in case party isn't there. Allow sqlDAO to ignore insert errors silently. 4bec38299c66cdf2cbb2317babde3c08dcd02ae1 Luigi Bai 2020-09-19 16:25:47
Allow passing in number of cases to update. ee680faa663867a52b2cbd49b68ba477f17c8cf0 Luigi Bai 2020-09-19 16:24:57
Give a heads up on how many cases will be udpated. 6624a0e47f1a2f326e4f079a93dc8beea84aae24 Luigi Bai 2020-09-18 21:37:32
Choose only Active cases or cases with NULLs to update. eadbf12cdc696dbe027578b2c352a09a2c6778b4 Luigi Bai 2020-09-18 21:37:13
Fix typo. 021fde3ca5c6697ea1c7c9cee00d4c2937fb6385 Luigi Bai 2020-09-18 21:36:36
Fix dates to YYYY-MM-DD on the way in, as much as possible. fa16c80ea14bad924f75ecc81d3cbfc4b2fe21e4 Luigi Bai 2020-09-18 21:36:20
Include some SQL scripts to update dates from the courts to YYYY-MM-DD. bde2825badffc0900955df5119107f38121eb14a Luigi Bai 2020-09-18 21:35:23
* improve date manipulation, replace moment with dayjs * (bug) Court.class extract parser now creates correct Docket and DocketedCase * don't bother with EXTRACT_HEARINGS, those are always empty * updateStatus updates status AND filed_Date 8ae2890852f5cb53c0429cc791098fee86f5b793 Luigi Bai 2020-09-18 02:49:03
Store case status and filedDate when available e0d7a3d44e4560e04133e777bdc0697bec57a8d4 Luigi Bai 2020-09-16 20:38:15
Clean up data xfer. Use TRUNCATE TABLE instead of DELETE FROM. e407788ccd1fb9ace1ca7cad4b0a1acd0189c799 Luigi Bai 2020-09-16 02:37:15
Clean up code. 3036e8ca177024179b3a6e391876121e526cd213 Luigi Bai 2020-09-16 02:36:42
Add bulkExtract importer. 0da4130e3e3a3e2e855f2ef28c4194fb6b5dfe10 Luigi Bai 2020-09-16 02:36:02
Add court related data 20f13f9ef9885794eddb2470bd57a9207dc7af20 Luigi Bai 2020-09-12 21:47:34
Try to avoid errors where information may be missing. 3410e49ba53bd7ebb417ee9bac7db1cf9e0e8808 Luigi Bai 2020-09-09 17:08:59
Don't put status information into console.log. 19dab8ff60a0256f9511391d4088c1b8f88ac3db Luigi Bai 2020-09-09 17:06:24
Add more info to README. 9708b396b887bab284e0ad2c2d996ea2db0ff4d4 Luigi Bai 2020-09-09 12:37:24
Add info to README. 79672fad423a570d7eb05c4891dfabb511db5ab3 Luigi Bai 2020-09-09 00:20:23
Commit 8d5f1c19cdf405281ceb9aa254c142d890da20a4 - Actually care more about reaching recent filed_date cases than casenumber. Often they'll be pretty close, but casenumber will sort by precinct/place instead of filing date.
Author: Luigi Bai
Author date (UTC): 2020-09-21 17:36
Committer name: Luigi Bai
Committer date (UTC): 2020-09-21 17:36
Parent(s): 40aaac1813b4dfa2ea2987027157cea491f81d2d
Signing key:
Tree: d2d5bcc9a058ba957d6949b50e59ae64a31b74e7
File Lines added Lines deleted
updateAddress.js 1 1
File updateAddress.js changed (mode: 100644) (index 0beff71..432e290)
... ... opts.connectCallback = database => {
45 45 // Track all the update promises, then wait until they're done: // Track all the update promises, then wait until they're done:
46 46 let promises = []; let promises = [];
47 47 database.each( database.each(
48 "SELECT casenumber as caseNumber FROM cases WHERE casenumber IS NOT NULL AND odyssey_ID IS NULL ORDER BY casenumber DESC LIMIT "+rowLimit,
48 "SELECT casenumber as caseNumber FROM cases WHERE casenumber IS NOT NULL AND odyssey_ID IS NULL ORDER BY filed_date DESC LIMIT "+rowLimit,
49 49 // This is the callback used for each case: // This is the callback used for each case:
50 50 (err, caseObj) => { (err, caseObj) => {
51 51 if (! caseObj.caseNumber) console.error("Database had case with no casenuber."); if (! caseObj.caseNumber) console.error("Database had case with no casenuber.");
Hints:
Before first commit, do not forget to setup your git environment:
git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):
git clone https://rocketgit.com/user/datajams-lbai/datajams-evictions

Clone this repository using ssh (do not forget to upload a key first):
git clone ssh://rocketgit@ssh.rocketgit.com/user/datajams-lbai/datajams-evictions

Clone this repository using git:
git clone git://git.rocketgit.com/user/datajams-lbai/datajams-evictions

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:
... clone the repository ...
... make some changes and some commits ...
git push origin main