dleucas / wmmsdb (public) (License: GPLv3) (since 2018-07-08) (hash sha1)
A collection of scripts to download, transform and normalize the Watkins Marine Mammal Sound Database.

Credit:

“Watkins Marine Mammal Sound Database, Woods Hole Oceanographic Institution.”

http://cis.whoi.edu/science/B/whalesounds/index.cfm
Clone URLs: https://rocketgit.com/user/dleucas/wmmsdb ssh://rocketgit@ssh.rocketgit.com/user/dleucas/wmmsdb git://git.rocketgit.com/user/dleucas/wmmsdb
master species_names
List of commits:
Subject Hash Author Date (UTC)
add links, add coverage task d9ddc331b713ac1be97040e8556f84ed46d1ccec d.leucas@outlook.com 2018-07-08 22:40:04
WIP signal class 79e6fea2d2a914e9c84528f1b184709e43e5f750 d.leucas@outlook.com 2018-07-08 22:39:17
add signal cut size and quality e78c447e83644b9eb9f950b2deaadac0fc5e6dda d.leucas@outlook.com 2018-07-08 22:06:35
add sample rate and number of channels b263b658641471fd455ef5215d65a86959097471 d.leucas@outlook.com 2018-07-08 21:11:39
as markdown d9fa587724fd2a46bf3373a8d549c4a39746a3aa dleucas 2018-07-08 00:54:09
add info on cue values 8e60832b65879f8c11a794715fa51bb2a0d2488b dleucas 2018-07-08 00:53:26
WIP: postion transform, cue and time done 82dde8774e24b1c582a4ac222758e9b98da28961 dleucas 2018-07-08 00:51:45
initial jq transform filter a688a9ec40d59a7de841eb86e1eeca72c64664b2 dleucas 2018-07-07 23:48:50
add ignores f8b235e00a265d3c4a6613e3174018ef754f2407 dleucas 2018-07-07 22:06:53
rename to markdown 8f99257ba05ee39b629b7d2281c149bbbe941b29 dleucas 2018-07-07 22:06:15
markdown 0a1aa88a79caad45e62f086716592e00b51ff36e dleucas 2018-07-07 22:06:03
progress 65700e843b38245a91b97658f63d640c70cefe6f dleucas 2018-07-07 02:30:36
transform HTML table to JSON object 058f59f35e7e40c437609d91889ceb5a786e005b dleucas 2018-07-07 02:29:29
initial data survey 7a0ba30602c78bf1f06a19d4322e503e3d11e050 dleucas 2018-07-07 02:28:12
progress information 90dca6f739de3887394810e419457412cb2fd9fa dleucas 2018-07-06 01:42:38
working download of metadata pages 071d8ad292bcf1486ce55f85eb0bc2102ab9c09a dleucas 2018-07-06 01:42:06
download metadata pages, initial script ed63b4125deec37961e76b0f45592ad8549483d4 dleucas 2018-07-06 00:12:09
Commit d9ddc331b713ac1be97040e8556f84ed46d1ccec - add links, add coverage task
Author: d.leucas@outlook.com
Author date (UTC): 2018-07-08 22:40
Committer name: d.leucas@outlook.com
Committer date (UTC): 2018-07-08 22:40
Parent(s): 79e6fea2d2a914e9c84528f1b184709e43e5f750
Signer:
Signing key:
Signing status: N
Tree: 498bca66c06417d9471d2851719f7be4762484cf
File Lines added Lines deleted
TODO.md 3 1
File TODO.md changed (mode: 100644) (index eb89c96..65298c1)
2 2
3 3 ## Deluxe Remaster Edition 2018 ## Deluxe Remaster Edition 2018
4 4
5 Source: http://cis.whoi.edu/science/B/whalesounds/fullCuts.cfm
5 Data Source: http://cis.whoi.edu/science/B/whalesounds/fullCuts.cfm
6 Source Code: https://rocketgit.com/user/dleucas/wmmsdb
6 7
7 8 # Overall Goal # Overall Goal
8 9
 
... ... Make the Sound Database more accessible and useful for researchers
13 14 - Index metadata into ElasticSearch for easy exploration and search - Index metadata into ElasticSearch for easy exploration and search
14 15 - Import metadata into SQLite for adavanced queries - Import metadata into SQLite for adavanced queries
15 16 - Explain every step of the process, somewhat of a tutorial - Explain every step of the process, somewhat of a tutorial
17 - Count coverage of data before and after transformation
16 18
17 19 Tools: bash, curl, wget, jq, xidel, xpath, regex, ElasticSearch, sqlite Tools: bash, curl, wget, jq, xidel, xpath, regex, ElasticSearch, sqlite
18 20
Hints:
Before first commit, do not forget to setup your git environment:
git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):
git clone https://rocketgit.com/user/dleucas/wmmsdb

Clone this repository using ssh (do not forget to upload a key first):
git clone ssh://rocketgit@ssh.rocketgit.com/user/dleucas/wmmsdb

Clone this repository using git:
git clone git://git.rocketgit.com/user/dleucas/wmmsdb

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:
... clone the repository ...
... make some changes and some commits ...
git push origin main