dleucas / wmmsdb (public) (License: GPLv3) (since 2018-07-08) (hash sha1)
A collection of scripts to download, transform and normalize the Watkins Marine Mammal Sound Database.

Credit:

“Watkins Marine Mammal Sound Database, Woods Hole Oceanographic Institution.”

http://cis.whoi.edu/science/B/whalesounds/index.cfm
Clone URLs: https://rocketgit.com/user/dleucas/wmmsdb ssh://rocketgit@ssh.rocketgit.com/user/dleucas/wmmsdb git://git.rocketgit.com/user/dleucas/wmmsdb
master species_names
List of commits:
Subject Hash Author Date (UTC)
ElasticSearch field schema c7d00ee0ec404284ba4f8a6b5851984c0b246d6f dleucas 2018-07-18 20:56:31
(re-)create index with mapping a2d442dbe6c9e37de4dfdba6ed8ab99362914303 dleucas 2018-07-18 20:55:49
add note field for UI display 254ef4bc795c4bc950fed1fdc9331fab4d4aff8d dleucas 2018-07-18 20:54:57
split genus field into animal.genus and signal.source 0623a1e4e9cb69f3f4fc1877ecd1d82b17e4d1f1 dleucas 2018-07-18 00:04:27
map animal sex to full name and cast age and year as numbers 3d4c27a2f0e1158c2f4df255411621a75fe210db dleucas 2018-07-17 22:24:26
add usage to README 4494a52a780e1355b99d50efb72d95f65a5d44b6 dleucas 2018-07-17 17:32:37
add server configuration snippets c4c85d654da4ec740b05276e402cd27e04211352 dleucas 2018-07-17 17:28:54
create README and split TODO off 4a8a8703ee22526df4b67fde905104276da91993 dleucas 2018-07-17 17:17:55
rename dl.sh to download.sh 2012a704ca1860b1a13adc84e7f81b1081112df5 dleucas 2018-07-17 17:04:42
add website UI using FacetView2 6ddc0848aa2431a80365d1fb37459eb93df7b138 dleucas 2018-07-17 17:03:50
make executable 3780e50d405d0b715d419f544fa0fd1a383f5949 dleucas 2018-07-15 01:43:52
WIP index transformed data using ElasticSearch e853933e0590103f984bfe195efb760a58b0ba13 dleucas 2018-07-15 01:43:26
add actual transform command a055bb616196a9e1141e97103d455dc97dd32060 dleucas 2018-07-15 01:41:56
recent ElasticSearch does not like _id in the document 7176097fbf555ce90fdce3647736993284cd8ec0 dleucas 2018-07-15 01:34:51
add interaction and use consistent namespace 00f70c27b706cd2138f53117008ea88fc25582ad dleucas 2018-07-14 22:20:46
adding animal age, sex and id 142570dba33128de7b6b93c3044f1e6ea03ee735 dleucas 2018-07-14 03:55:22
add vocal animal id and species code 8b0138515bff58ed980e6c6cdac93724f31e7a7d dleucas 2018-07-13 18:50:14
normalize signal overlap types 57bf11ebad27db0a8aea7dec400554780798d46d dleucas 2018-07-12 20:44:41
add signal class, use null not empty f108fc71216ede0be40ef5a6749ddef5b714721c dleucas 2018-07-12 20:17:03
code formating 5c53a7166dfbf8485f81c8800a636a5919956f4b d.leucas@outlook.com 2018-07-12 00:34:57
Commit c7d00ee0ec404284ba4f8a6b5851984c0b246d6f - ElasticSearch field schema
Author: dleucas
Author date (UTC): 2018-07-18 20:56
Committer name: dleucas
Committer date (UTC): 2018-07-18 20:56
Parent(s): a2d442dbe6c9e37de4dfdba6ed8ab99362914303
Signer:
Signing key:
Signing status: N
Tree: 95f61f4dbdeae50c3b68e282e3e49c61f26f04e0
File Lines added Lines deleted
index.mapping.json 153 0
File index.mapping.json added (mode: 100644) (index 0000000..731319e)
1 {
2 "record": {
3 "properties": {
4 "animal": {
5 "properties": {
6 "_source_id": {
7 "type": "string",
8 "index": "no"
9 },
10 "genus": {
11 "properties": {
12 "name": {
13 "type": "string",
14 "index": "not_analyzed"
15 },
16 "species_code": {
17 "type": "string",
18 "index": "not_analyzed"
19 }
20 }
21 },
22 "interaction": {
23 "properties": {
24 "animal_id": {
25 "type": "string",
26 "index": "not_analyzed"
27 },
28 "type": {
29 "type": "string",
30 "index": "not_analyzed"
31 }
32 }
33 },
34 "profile": {
35 "properties": {
36 "age": {
37 "type": "long"
38 },
39 "animal_id": {
40 "type": "string",
41 "index": "not_analyzed"
42 },
43 "birth_year": {
44 "type": "long"
45 },
46 "sex": {
47 "type": "string",
48 "index": "not_analyzed"
49 }
50 }
51 },
52 "vocal": {
53 "properties": {
54 "animal_id": {
55 "type": "string",
56 "index": "not_analyzed"
57 },
58 "species_code": {
59 "type": "string",
60 "index": "not_analyzed"
61 }
62 }
63 }
64 }
65 },
66 "record_number": {
67 "type": "string",
68 "index": "not_analyzed"
69 },
70 "note": {
71 "type": "string"
72 },
73 "signal": {
74 "properties": {
75 "_source_sc": {
76 "type": "string",
77 "index": "no"
78 },
79 "class": {
80 "type": "string",
81 "index": "not_analyzed"
82 },
83 "cut_size": {
84 "type": "double"
85 },
86 "overlap": {
87 "type": "string",
88 "index": "not_analyzed"
89 },
90 "position": {
91 "properties": {
92 "_source_cu": {
93 "type": "string",
94 "index": "no"
95 },
96 "analyzer_buffer_size": {
97 "type": "string",
98 "index": "not_analyzed"
99 },
100 "cue": {
101 "type": "long"
102 },
103 "time": {
104 "type": "string",
105 "index": "not_analyzed"
106 }
107 }
108 },
109 "quality": {
110 "type": "long"
111 },
112 "source": {
113 "properties": {
114 "name": {
115 "type": "string",
116 "index": "not_analyzed"
117 },
118 "order": {
119 "type": "string",
120 "index": "not_analyzed"
121 }
122 }
123 }
124 }
125 },
126 "sound": {
127 "properties": {
128 "channel": {
129 "properties": {
130 "_source_nc": {
131 "type": "string",
132 "index": "no"
133 },
134 "multiplexed": {
135 "type": "long"
136 },
137 "recorded": {
138 "type": "long"
139 },
140 "side": {
141 "type": "string",
142 "index": "not_analyzed"
143 }
144 }
145 },
146 "sample_rate": {
147 "type": "long"
148 }
149 }
150 }
151 }
152 }
153 }
Hints:
Before first commit, do not forget to setup your git environment:
git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):
git clone https://rocketgit.com/user/dleucas/wmmsdb

Clone this repository using ssh (do not forget to upload a key first):
git clone ssh://rocketgit@ssh.rocketgit.com/user/dleucas/wmmsdb

Clone this repository using git:
git clone git://git.rocketgit.com/user/dleucas/wmmsdb

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:
... clone the repository ...
... make some changes and some commits ...
git push origin main