dleucas / wmmsdb (public) (License: GPLv3) (since 2018-07-08) (hash sha1)
A collection of scripts to download, transform and normalize the Watkins Marine Mammal Sound Database.

Credit:

“Watkins Marine Mammal Sound Database, Woods Hole Oceanographic Institution.”

http://cis.whoi.edu/science/B/whalesounds/index.cfm
List of commits:
Subject Hash Author Date (UTC)
fix spelling and use pandoc title d66f11d8c855ef270ebde81ff5a55473729633f2 dleucas 2019-05-22 22:30:08
Revert "fix spelling and use pandoc title feature" 4a5aca9355e0a2221591047e7b4b56b5e42414e6 dleucas 2019-05-22 22:23:50
fix spelling and use pandoc title feature dc3c3f6b98235fb9d7268ccd5b5c5fb62b52a93c dleucas 2019-05-22 21:54:03
WIP about page 2483c1505cd3379dc9609661e90a4718ea4f6aeb dleucas 2019-05-20 00:07:03
better site description 559a9ece7031d493cec54754aa8f125446e8ad37 dleucas 2019-05-17 15:46:45
add link to world map e865344ba45c24781889924747d0777bbd74128c dleucas 2019-05-17 15:41:51
add map using arcgis.js facbffd944ef65cdea19ec292633b75d1232cd2b dleucas 2019-05-17 14:52:40
add location and date 55d68f71ef5da4edf39b2aad1ac0e55c9236e3b8 dleucas 2019-05-17 14:47:50
document GeoJSON command 8a0c9437ad2c7920d48125ab16795e9d2eb4aae7 dleucas 2019-05-17 02:43:44
working coordinate conversion 93690c423d103a8c643eb736c49f5086c97569ab dleucas 2019-05-17 02:26:16
WIP GeoJSON transformation 0fb3c00fe05abdab66a505526412273340a57c02 dleucas 2018-08-04 03:16:55
add filter by location name 043ca941dd733b0c36274576ec17680255f75646 dleucas 2018-07-25 20:13:46
index settings for location name. also use english for notes 6ccc4e6332fb40b2556c2570e9c3cdbb5a48f8a3 dleucas 2018-07-25 20:13:19
add location names c67e4b4eea6c4ef16337e3eac6eb10ae16393430 dleucas 2018-07-25 18:32:45
use tables for result display and add sort options 19d650a762c7eee577068f17af8af6042e68706f dleucas 2018-07-24 00:28:13
enlarge image on click, display acoustat values cd4cdd355ea4fcd09dbb3c5a3dd46b9e1a2695e5 dleucas 2018-07-23 23:39:39
typo, P2 was not assigned correctly 4fd59e536c917da8a828f30165aae953a6c9455b dleucas 2018-07-23 23:38:58
change spectrogram paramters 14777e7d7c82c664b1fcc3b588fa123e8e124d04 dleucas 2018-07-23 23:38:31
acustat, dl link, spectograms da953b3e7c5c3b4ee2d523ee9773b5c379b4fec1 dleucas 2018-07-22 00:39:51
scripts for processing wave audio files d23b5a2edc5b279ac6998a754a765e6a9e4dcda2 dleucas 2018-07-21 20:04:10
Commit d66f11d8c855ef270ebde81ff5a55473729633f2 - fix spelling and use pandoc title
Author: dleucas
Author date (UTC): 2019-05-22 22:30
Committer name: dleucas
Committer date (UTC): 2019-05-22 22:30
Parent(s): 4a5aca9355e0a2221591047e7b4b56b5e42414e6
Signer:
Signing key:
Signing status: N
Tree: 45f84066816dfe8a0c542e186899144caf88f9ea
File Lines added Lines deleted
webroot/about.md 13 10
File webroot/about.md changed (mode: 100644) (index 436e174..8b19b4f)
1 ## About the Watkins Marine Mammal Sound Database
1 % About Watkins Marine Mammal Sound Database (2018 Remaster)
2 2
3 See the about page at [0][Woods Hole Oceanographic Institution] for a detailed description of the database.
3 ## About the Watkins Marine Mammal Sound Database
4 4
5 See the about page at [Woods Hole Oceanographic Institution][whoi.about] for a detailed description of the database.
5 6
6 [0][https://whoicf2.whoi.edu/science/B/whalesounds/about.cfm]
7 [whoi.about]: https://whoicf2.whoi.edu/science/B/whalesounds/about.cfm
7 8
8 9 ## About the Remaster ## About the Remaster
9 10
 
... ... This project aims to make the 15,000 annotated digital sound clips accessible fo
16 17 The current (2018) WHOI website is very limited in its features to explore sound clips and recordings. The current (2018) WHOI website is very limited in its features to explore sound clips and recordings.
17 18 Most of the detailed metadata, that describe all sound clips, can not be used as search filters and are hardly explained. Most of the detailed metadata, that describe all sound clips, can not be used as search filters and are hardly explained.
18 19
19 As the [0][about page] states:
20 As the [about page][whoi.about] states:
20 21
21 > Due to the outdated and nonstandard format of the metadata, letters and codes may appear in some of the tables. These codes are described in the publication of the original DOS-based database.
22 > Due to the outdated and nonstandard format of the metadata, letters and codes may appear in some of the tables.
23 > These codes are described in the publication of the original DOS-based database.
22 24
23 25 Cleaning up that metadata is therefor one of the main tasks of this project. Cleaning up that metadata is therefor one of the main tasks of this project.
24 26
 
... ... All sound clips, recordings and metadata can be directly downloaded or scraped f
26 28
27 29 ### Project Outline ### Project Outline
28 30
29 Achiving the goal means:
31 Implementing the goal means:
30 32
31 33 - Understanding what questions and requirements researchers have - Understanding what questions and requirements researchers have
32 34 - What the data contains to offer answers - What the data contains to offer answers
 
... ... Achiving the goal means:
38 40 #### Requirements #### Requirements
39 41
40 42 - A researcher needs to be confident, that that data is accurate. - A researcher needs to be confident, that that data is accurate.
41 The transformation should not introduce errors, and if any occure they should be documented.
42
43 The transformation should not introduce errors, and if any occur they should be documented.
43 44 - A researcher needs to be able to reproduce the data transformation - A researcher needs to be able to reproduce the data transformation
44 45 - A researcher needs to reference a specific state of the (transformed) data - A researcher needs to reference a specific state of the (transformed) data
45 46
 
... ... The following outlines the to-do's of the project.
55 56
56 57 - Extract, normalize and transform all information from the database - Extract, normalize and transform all information from the database
57 58 - Document the details of the database contents - Document the details of the database contents
58 - Develop and document the data transformation process as fully reproducable open source code
59 - Develop the data transformation process as open source code
60 - Document all steps required to reproduce the resulting data
59 61 - Make all transformed data available as versioned download - Make all transformed data available as versioned download
62 - Code and data should follow the same version schema, to clarify what code produced what data.
60 63
61 64 #### Build a user interface for research #### Build a user interface for research
62 65
 
... ... The following outlines the to-do's of the project.
67 70 #### Enrich the data #### Enrich the data
68 71
69 72 - Analyze all sound clips and expose gained statistical values as search filters - Analyze all sound clips and expose gained statistical values as search filters
70 - Use the location description to get more preceise location coordinates
73 - Use the location description to get more precise location coordinates
71 74
Hints:
Before first commit, do not forget to setup your git environment:
git config --global user.name "your_name_here"
git config --global user.email "your@email_here"

Clone this repository using HTTP(S):
git clone https://rocketgit.com/user/dleucas/wmmsdb

Clone this repository using ssh (do not forget to upload a key first):
git clone ssh://rocketgit@ssh.rocketgit.com/user/dleucas/wmmsdb

Clone this repository using git:
git clone git://git.rocketgit.com/user/dleucas/wmmsdb

You are allowed to anonymously push to this repository.
This means that your pushed commits will automatically be transformed into a merge request:
... clone the repository ...
... make some changes and some commits ...
git push origin main