dleucas / wmmsdb (public) (License: GPLv3) (since 2018-07-08) (hash sha1)
A collection of scripts to download, transform and normalize the Watkins Marine Mammal Sound Database.

Credit:

“Watkins Marine Mammal Sound Database, Woods Hole Oceanographic Institution.”

http://cis.whoi.edu/science/B/whalesounds/index.cfm
Clone URLs: https://rocketgit.com/user/dleucas/wmmsdb ssh://rocketgit@ssh.rocketgit.com/user/dleucas/wmmsdb git://git.rocketgit.com/user/dleucas/wmmsdb
master species_names

/index.sh (7abb8bcf9a49d7c849ab50538e47c9033a921f28) (482 bytes) (mode 100755) (type blob)

#!/bin/bash
# create JSON for ElasticSearch _bulk interface and pipe it directly in
# --raw-output --compact-output matter or ES won't accept it

CURL="curl -s"
ES=localhost:9200
IDX=wmmsdb

$CURL -XDELETE $ES/$IDX | jq .
$CURL -XPUT $ES/$IDX | jq .
$CURL -XPUT $ES/$IDX/_mapping/record -d@index.mapping.json | jq .

jq --raw-output --compact-output -f index.jq data/transformed.json | $CURL -s -H "Content-Type: application/x-ndjson" -XPOST $ES/_bulk --data-binary "@-" | jq .took

Mode Type Size Ref File
100644 blob 11 dea9097138acee79ce13ef95ecaed594eea1fc34 .gitignore
100644 blob 2019 fa6fa76919a7cf93fba42f24e05ce897839c8bd2 DATA.md
100755 blob 1964 77e9f5c9baaa1276ae068eeb31f51d0fe7ca4893 GeoJSON.jq
100644 blob 864 e0082817c39b573df78e0ed2d3e2d4cfc9255036 README.md
100644 blob 865 6ac29799fea3cd2dd8c0e8116a12e6da93809572 TODO.md
100755 blob 1509 d154c6171b793c0b32b8f3020b6703ca4fdcc1ee download.sh
100644 blob 218 9100d4eb109a354733264a3b989d0de699db3c9c index.jq
100644 blob 4648 8029c7e3c56f4c61e38ec0abc8135bc1a063071b index.mapping.json
100755 blob 482 7abb8bcf9a49d7c849ab50538e47c9033a921f28 index.sh
040000 tree - 60e19bf3f6e7f2fba709ae362e565cf2df36ac29 snd
040000 tree - 6e02959705bd738b6776f95e9db4ad6e7abdbcd1 srv
100644 blob 8614 475fb0324d694a9e90c19017b971e5dd5b23aa15 transform.jq
100755 blob 1336 93d9e62fb6f1e4b2444fb3c8ded4ea6a856c7c13 transform.sh
040000 tree - 4e40690ecd154bee3b72ed1a53388af8534ddafb webroot
Hints:
Before first commit, do not forget to setup your git environment:
git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):
git clone https://rocketgit.com/user/dleucas/wmmsdb

Clone this repository using ssh (do not forget to upload a key first):
git clone ssh://rocketgit@ssh.rocketgit.com/user/dleucas/wmmsdb

Clone this repository using git:
git clone git://git.rocketgit.com/user/dleucas/wmmsdb

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:
... clone the repository ...
... make some changes and some commits ...
git push origin main