dleucas / wmmsdb (public) (License: GPLv3) (since 2018-07-08) (hash sha1)
A collection of scripts to download, transform and normalize the Watkins Marine Mammal Sound Database.

Credit:

“Watkins Marine Mammal Sound Database, Woods Hole Oceanographic Institution.”

http://cis.whoi.edu/science/B/whalesounds/index.cfm
Clone URLs: https://rocketgit.com/user/dleucas/wmmsdb ssh://rocketgit@ssh.rocketgit.com/user/dleucas/wmmsdb git://git.rocketgit.com/user/dleucas/wmmsdb
master species_names
List of commits:
Subject Hash Author Date (UTC)
add signal cut size and quality 9174f89773c2b6e934bffb3c2ab329c73350b025 dleucas 2018-07-08 22:06:35
add sample rate and number of channels c32ad9d8dc8b2e461e4869c60d9cee132047f4b1 dleucas 2018-07-08 21:11:39
as markdown d9fa587724fd2a46bf3373a8d549c4a39746a3aa dleucas 2018-07-08 00:54:09
add info on cue values 8e60832b65879f8c11a794715fa51bb2a0d2488b dleucas 2018-07-08 00:53:26
WIP: postion transform, cue and time done 82dde8774e24b1c582a4ac222758e9b98da28961 dleucas 2018-07-08 00:51:45
initial jq transform filter a688a9ec40d59a7de841eb86e1eeca72c64664b2 dleucas 2018-07-07 23:48:50
add ignores f8b235e00a265d3c4a6613e3174018ef754f2407 dleucas 2018-07-07 22:06:53
rename to markdown 8f99257ba05ee39b629b7d2281c149bbbe941b29 dleucas 2018-07-07 22:06:15
markdown 0a1aa88a79caad45e62f086716592e00b51ff36e dleucas 2018-07-07 22:06:03
progress 65700e843b38245a91b97658f63d640c70cefe6f dleucas 2018-07-07 02:30:36
transform HTML table to JSON object 058f59f35e7e40c437609d91889ceb5a786e005b dleucas 2018-07-07 02:29:29
initial data survey 7a0ba30602c78bf1f06a19d4322e503e3d11e050 dleucas 2018-07-07 02:28:12
progress information 90dca6f739de3887394810e419457412cb2fd9fa dleucas 2018-07-06 01:42:38
working download of metadata pages 071d8ad292bcf1486ce55f85eb0bc2102ab9c09a dleucas 2018-07-06 01:42:06
download metadata pages, initial script ed63b4125deec37961e76b0f45592ad8549483d4 dleucas 2018-07-06 00:12:09
Commit 9174f89773c2b6e934bffb3c2ab329c73350b025 - add signal cut size and quality
Author: dleucas
Author date (UTC): 2018-07-08 22:06
Committer name: dleucas
Committer date (UTC): 2018-07-08 22:06
Parent(s): c32ad9d8dc8b2e461e4869c60d9cee132047f4b1
Signer:
Signing key:
Signing status: N
Tree: 43f481b249c229bd46f2ac65d7bc8797a40ac21f
File Lines added Lines deleted
transform.jq 25 1
File transform.jq changed (mode: 100644) (index a06410b..6abe3e3)
38 38 # buffer size, B followed by integer with colon or dot, also remove B prefix # buffer size, B followed by integer with colon or dot, also remove B prefix
39 39 # TODO match 2 colon version # TODO match 2 colon version
40 40 (.CU | capture("(?<analyzer_buffer_size>(?<=B)\\d+[:\\.]\\d+(\\.\\d+)?)") ) (.CU | capture("(?<analyzer_buffer_size>(?<=B)\\d+[:\\.]\\d+(\\.\\d+)?)") )
41 ] | add
41 ] | add,
42 # cut size
43 # 3.36
44 # 9.411
45 # 16.564
46 # 20.35
47 # etc
48 # only 210 records use a different format, ignored for now
49 # 2:00.000
50 # 1:00.030
51 # 10:25.540
52 # 1:25.158
53 # etc.
54 cut_size: (
55 # skip empty records, or with a colon
56 if (.CS | contains(":") or (length == 0)) then
57 empty
58 else
59 # cast as number and handle a few remaining badly formated records like "0.2.95"
60 (try (.CS | tonumber) catch empty)
61 end
62 ),
63 # any digit in the signal class indicates quality
64 # it's only been used 121 times
65 quality: ( .SC | capture("(?<q>\\d+)") | .q | tonumber )
42 66 }, },
43 67 sound: { sound: {
44 68 # plain sample rate as number, however not normalized in digit length # plain sample rate as number, however not normalized in digit length
Hints:
Before first commit, do not forget to setup your git environment:
git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):
git clone https://rocketgit.com/user/dleucas/wmmsdb

Clone this repository using ssh (do not forget to upload a key first):
git clone ssh://rocketgit@ssh.rocketgit.com/user/dleucas/wmmsdb

Clone this repository using git:
git clone git://git.rocketgit.com/user/dleucas/wmmsdb

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:
... clone the repository ...
... make some changes and some commits ...
git push origin main