datajams-lbai / datajams-evictions (public) (License: AGPLv3) (since 2020-09-01) (hash sha1)
Extracting Harris County evictions information for Houston DataJams
Clone URLs: https://rocketgit.com/user/datajams-lbai/datajams-evictions ssh://rocketgit@ssh.rocketgit.com/user/datajams-lbai/datajams-evictions git://git.rocketgit.com/user/datajams-lbai/datajams-evictions
No history found.

README.md:

datajams-evictions

Software Needed

  • node.js:. This is known to run in version 10.x. Higher versions may work.
  • npm : should be included in the download above.

Local data storage is in SQLITE3. You should only need to download software if you want to independently access the database.

Remote data storage is (currently) in MS SQL Server on Azure. You will need the mssql javascript package from npm to connect.

How to Use

  1. Download node.js as above.
  2. run npm install to pull in the dependencies.
  3. copy "creds.example.js" to "creds.js" and edit it to put in your remote database credentials.
  4. initialize your local SQLITE3 database
    1. if you have install SQLITE3 as above: sqlite3 eviction-data.sq3 < schema.sqlite.sql
      • otherwise, someone could make a script like node initSqliteDB
  5. run
    1. node loadDockets to load in docket information to a local SQLITE3 database
    2. node updateStatus to update the status of each of the cases in the database
    3. node updateAddress to update 10 cases to get party addresses.
      • Note: It seems you can do this about once a minute. Any faster and they seem to lock you out.
    4. node searchNames 'NAME' to load in cases where NAME is a party
      • Note: the quotes are really helpful especially if NAME has a space in it, such as '2015 HOUSTON'
  6. Transfer data to Azure: node xferData
    • NOTE WELL Don't do this. It will erase all the data up at Azure and replace it with the data from your local SQLITE3 database.
    • You probably don't have as much data as I do.
    • Maybe someone could make a script like node pullData to grab data from Azure to local.
Hints:
Before first commit, do not forget to setup your git environment:
git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):
git clone https://rocketgit.com/user/datajams-lbai/datajams-evictions

Clone this repository using ssh (do not forget to upload a key first):
git clone ssh://rocketgit@ssh.rocketgit.com/user/datajams-lbai/datajams-evictions

Clone this repository using git:
git clone git://git.rocketgit.com/user/datajams-lbai/datajams-evictions

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:
... clone the repository ...
... make some changes and some commits ...
git push origin main