datajams-lbai / datajams-evictions (public) (License: AGPLv3) (since 2020-09-01) (hash sha1)
Extracting Harris County evictions information for Houston DataJams
Clone URLs: https://rocketgit.com/user/datajams-lbai/datajams-evictions ssh://rocketgit@ssh.rocketgit.com/user/datajams-lbai/datajams-evictions git://git.rocketgit.com/user/datajams-lbai/datajams-evictions
first
List of commits:
Subject Hash Author Date (UTC)
Add court related data 20f13f9ef9885794eddb2470bd57a9207dc7af20 Luigi Bai 2020-09-12 21:47:34
Try to avoid errors where information may be missing. 3410e49ba53bd7ebb417ee9bac7db1cf9e0e8808 Luigi Bai 2020-09-09 17:08:59
Don't put status information into console.log. 19dab8ff60a0256f9511391d4088c1b8f88ac3db Luigi Bai 2020-09-09 17:06:24
Add more info to README. 9708b396b887bab284e0ad2c2d996ea2db0ff4d4 Luigi Bai 2020-09-09 12:37:24
Add info to README. 79672fad423a570d7eb05c4891dfabb511db5ab3 Luigi Bai 2020-09-09 00:20:23
Fixed searchNames. Now you can load cases where you know one of the parties. 0ad812704e27341a481a6de18c88a4f38bb61700 Luigi Bai 2020-09-08 23:43:48
Apparently updating addresses works, as long as you don't ask for more than 10 per minute. That seems to be working so far. 9276b2acb2cc3067c53fc16317a8960db3f6fcca Luigi Bai 2020-09-08 22:44:24
More information about how to use the software. Not much, yet. Enough to get started, I think. 393fce58bbcfeaee947cb2b0e17d81d16da49612 Luigi Bai 2020-09-08 22:31:02
Don't write to console.err if there's a rejectionFunction. 630b8ec76a21733a6bb93d98ca54563aadd61da4 Luigi Bai 2020-09-08 22:30:29
Remove trailing comma on all rows. e7605fa152a841eefc7fcab6bb7cfd64daf28b17 Luigi Bai 2020-09-07 22:43:36
Allow passing in query for Case.sqlAllCases() 346862c0720ef9054426048cc95caa8f6b068868 Luigi Bai 2020-09-07 22:43:09
This version works in MS-SQL. 4e3f33f464173c91c3f4ac4b6acb0235ed2d6720 Luigi Bai 2020-09-07 19:11:54
Add headers. 4da1ccbdb2e3e852050de3460bc9ac9ba061ed7a Luigi Bai 2020-09-07 16:28:52
loadDockets now works to local. 96ba8f7419f63be6612fe1efd3e24d5d30eaf20a Luigi Bai 2020-09-06 20:59:06
Fix for new column names. 5791d77e19585c494e51c6062ab45440e5af0903 Luigi Bai 2020-09-06 20:44:50
Add headers 32cb7264c06b28dc0404b715f24fd2d82b66633b Luigi Bai 2020-09-06 20:44:29
Have a working version of xfer - now transfers data to MS SQL Server from SQLITE3. 428e493bcc5b7f718a741db046d08905f47d0f1c Luigi Bai 2020-09-05 22:11:55
Stupid MS SQL Server assumes case insensitive collation for text/char columns. Who does that? 2700846d8c1233d27664fb74b582293ddb8cb32a Luigi Bai 2020-09-05 21:11:17
Fixed MS schema - 4096 too big for varchar. ca3870f7e244d83e58d74c7f231baacbc19ba8fa Luigi Bai 2020-09-04 17:04:05
Remove interstitial console.log 19481f6692d9f93e75aa173bee9716261ef54db0 Luigi Bai 2020-09-04 12:07:33
Commit 20f13f9ef9885794eddb2470bd57a9207dc7af20 - Add court related data
Author: Luigi Bai
Author date (UTC): 2020-09-12 21:47
Committer name: Luigi Bai
Committer date (UTC): 2020-09-12 21:47
Parent(s): 3410e49ba53bd7ebb417ee9bac7db1cf9e0e8808
Signing key:
Tree: 1f0d3dde8eabdbe0180beb0ab92d6aac3bc62e01
File Lines added Lines deleted
schema.mssql.sql 25 0
schema.sqlite3.sql 72 5
File schema.mssql.sql changed (mode: 100644) (index 69eac4a..888ba8c)
1 DROP TABLE courts;
2 CREATE TABLE courts (
3 precinct integer,
4 place integer,
5 extractID integer,
6 courtURL nvarchar(1024),
7 streamURL nvarchar(1024)
8 );
9 INSERT INTO courts VALUES(1,1,305,'https://www.jp.hctx.net/1-1/default.htm','https://video.ibm.com/embed/23872866');
10 INSERT INTO courts VALUES(1,2,310,'https://www.jp.hctx.net/1-2/default.htm','https://video.ibm.com/embed/23872902');
11 INSERT INTO courts VALUES(2,1,315,'https://www.jp.hctx.net/2-1/default.htm','https://video.ibm.com/embed/23872792');
12 INSERT INTO courts VALUES(2,2,320,'https://www.jp.hctx.net/2-2/default.htm','https://video.ibm.com/embed/23872906');
13 INSERT INTO courts VALUES(3,1,325,'https://www.jp.hctx.net/3-1/default.htm','https://video.ibm.com/embed/23872913');
14 INSERT INTO courts VALUES(3,2,330,'https://www.jp.hctx.net/3-2/default.htm','https://video.ibm.com/embed/23872915');
15 INSERT INTO courts VALUES(4,1,335,'https://www.jp.hctx.net/4-1/default.htm','https://video.ibm.com/embed/23872925');
16 INSERT INTO courts VALUES(4,2,340,'https://www.jp.hctx.net/4-2/default.htm','https://video.ibm.com/embed/23872927');
17 INSERT INTO courts VALUES(5,1,345,'https://www.jp.hctx.net/5-1/default.htm','https://video.ibm.com/embed/23872940');
18 INSERT INTO courts VALUES(5,2,350,'https://www.jp.hctx.net/5-2/default.htm','https://video.ibm.com/embed/23872948');
19 INSERT INTO courts VALUES(6,1,355,'https://www.jp.hctx.net/6-1/default.htm','https://video.ibm.com/embed/23873840');
20 INSERT INTO courts VALUES(6,2,360,'https://www.jp.hctx.net/6-2/default.htm','https://video.ibm.com/embed/23873836');
21 INSERT INTO courts VALUES(7,1,365,'https://www.jp.hctx.net/7-1/default.htm','https://video.ibm.com/embed/23873956');
22 INSERT INTO courts VALUES(7,2,370,'https://www.jp.hctx.net/7-2/default.htm','https://video.ibm.com/embed/23873966');
23 INSERT INTO courts VALUES(8,1,375,'https://www.jp.hctx.net/8-1/default.htm','https://video.ibm.com/embed/23872892');
24 INSERT INTO courts VALUES(8,2,380,'https://www.jp.hctx.net/8-2/default.htm','https://video.ibm.com/embed/23873982');
25
1 26 DROP TABLE docket; DROP TABLE docket;
2 27 CREATE TABLE docket ( CREATE TABLE docket (
3 28 precinct INTEGER, precinct INTEGER,
File schema.sqlite3.sql changed (mode: 100644) (index dd314aa..a05db94)
1 CREATE TABLE docket (precinct INTEGER, place INTEGER, docket_dateTime TEXT, URL TEXT, docket_ID INTEGER PRIMARY KEY);
2 CREATE TABLE cases (casenumber TEXT, case_URL TEXT, odyssey_ID TEXT, odyssey_URL TEXT, case_ID INTEGER PRIMARY KEY, filed_Date TEXT, case_status TEXT);
3 CREATE TABLE docketedCases (precinct INTEGER, place INTEGER, docket_dateTime TEXT, casenumber TEXT, claim NUMBER, docketCaseID INTEGER PRIMARY KEY);
4 CREATE TABLE party (casenumber TEXT, party_role TEXT, party_name TEXT, party_address TEXT, party_ID INTEGER PRIMARY KEY);
1 DROP TABLE courts;
2 CREATE TABLE courts (
3 precinct integer,
4 place integer,
5 extractID integer,
6 courtURL nvarchar(1024),
7 streamURL nvarchar(1024)
8 );
9 INSERT INTO courts VALUES(1,1,305,'https://www.jp.hctx.net/1-1/default.htm','https://video.ibm.com/embed/23872866');
10 INSERT INTO courts VALUES(1,2,310,'https://www.jp.hctx.net/1-2/default.htm','https://video.ibm.com/embed/23872902');
11 INSERT INTO courts VALUES(2,1,315,'https://www.jp.hctx.net/2-1/default.htm','https://video.ibm.com/embed/23872792');
12 INSERT INTO courts VALUES(2,2,320,'https://www.jp.hctx.net/2-2/default.htm','https://video.ibm.com/embed/23872906');
13 INSERT INTO courts VALUES(3,1,325,'https://www.jp.hctx.net/3-1/default.htm','https://video.ibm.com/embed/23872913');
14 INSERT INTO courts VALUES(3,2,330,'https://www.jp.hctx.net/3-2/default.htm','https://video.ibm.com/embed/23872915');
15 INSERT INTO courts VALUES(4,1,335,'https://www.jp.hctx.net/4-1/default.htm','https://video.ibm.com/embed/23872925');
16 INSERT INTO courts VALUES(4,2,340,'https://www.jp.hctx.net/4-2/default.htm','https://video.ibm.com/embed/23872927');
17 INSERT INTO courts VALUES(5,1,345,'https://www.jp.hctx.net/5-1/default.htm','https://video.ibm.com/embed/23872940');
18 INSERT INTO courts VALUES(5,2,350,'https://www.jp.hctx.net/5-2/default.htm','https://video.ibm.com/embed/23872948');
19 INSERT INTO courts VALUES(6,1,355,'https://www.jp.hctx.net/6-1/default.htm','https://video.ibm.com/embed/23873840');
20 INSERT INTO courts VALUES(6,2,360,'https://www.jp.hctx.net/6-2/default.htm','https://video.ibm.com/embed/23873836');
21 INSERT INTO courts VALUES(7,1,365,'https://www.jp.hctx.net/7-1/default.htm','https://video.ibm.com/embed/23873956');
22 INSERT INTO courts VALUES(7,2,370,'https://www.jp.hctx.net/7-2/default.htm','https://video.ibm.com/embed/23873966');
23 INSERT INTO courts VALUES(8,1,375,'https://www.jp.hctx.net/8-1/default.htm','https://video.ibm.com/embed/23872892');
24 INSERT INTO courts VALUES(8,2,380,'https://www.jp.hctx.net/8-2/default.htm','https://video.ibm.com/embed/23873982');
25
26 DROP TABLE docket;
27 CREATE TABLE docket (
28 precinct INTEGER,
29 place INTEGER,
30 docket_dateTime TEXT,
31 URL NVARCHAR(1024),
32 docket_ID INTEGER PRIMARY KEY
33 );
34
35 DROP TABLE docketedCases;
36 CREATE TABLE docketedCases (
37 precinct INTEGER,
38 place INTEGER,
39 docket_dateTime TEXT,
40 casenumber NVARCHAR(64),
41 claim NUMBER,
42 docketCaseID INTEGER PRIMARY KEY
43 );
44
45 DROP TABLE cases;
46 CREATE TABLE cases (
47 casenumber NVARCHAR(64),
48 case_URL NVARCHAR(1024),
49 odyssey_ID NVARCHAR(1024),
50 odyssey_URL NVARCHAR(1024),
51 filed_Date NVARCHAR(32),
52 case_status NVARCHAR(256),
53 case_ID INTEGER PRIMARY KEY
54 );
55
56 DROP TABLE party;
57 CREATE TABLE party (
58 casenumber NVARCHAR(64),
59 party_role NVARCHAR(32),
60 party_name NVARCHAR(1024),
61 party_address NVARCHAR(4000),
62 party_ID INTEGER PRIMARY KEY
63 );
64
65 DROP TABLE events;
66 CREATE TABLE events (
67 casenumber NVARCHAR(64),
68 eventDescription NVARCHAR(4000),
69 dateAdded NVARCHAR(32),
70 eventID INTEGER PRIMARY KEY
71 );
72
5 73 CREATE UNIQUE INDEX docketTime on docket (precinct, place, docket_dateTime); CREATE UNIQUE INDEX docketTime on docket (precinct, place, docket_dateTime);
6 74 CREATE UNIQUE INDEX docketedCase on docketedCases (precinct, place, docket_dateTime, casenumber); CREATE UNIQUE INDEX docketedCase on docketedCases (precinct, place, docket_dateTime, casenumber);
7 75 CREATE UNIQUE INDEX casenum on cases (casenumber); CREATE UNIQUE INDEX casenum on cases (casenumber);
8 76 CREATE UNIQUE INDEX partyIdx on party (casenumber, party_role, party_name); CREATE UNIQUE INDEX partyIdx on party (casenumber, party_role, party_name);
9 CREATE TABLE events (casenumber TEXT, eventDescription TEXT, dateAdded TEXT, eventID INTEGER PRIMARY KEY);
10 77 CREATE UNIQUE INDEX eventIdx on events (casenumber, eventDescription, dateAdded); CREATE UNIQUE INDEX eventIdx on events (casenumber, eventDescription, dateAdded);
Hints:
Before first commit, do not forget to setup your git environment:
git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):
git clone https://rocketgit.com/user/datajams-lbai/datajams-evictions

Clone this repository using ssh (do not forget to upload a key first):
git clone ssh://rocketgit@ssh.rocketgit.com/user/datajams-lbai/datajams-evictions

Clone this repository using git:
git clone git://git.rocketgit.com/user/datajams-lbai/datajams-evictions

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:
... clone the repository ...
... make some changes and some commits ...
git push origin main