You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/source/core_api/index.rst
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ TimeSide core API
4
4
5
5
TimeSide is first a python framework enabling low and high level audio analysis, imaging, transcoding, streaming and labelling. Its high-level API is designed to enable complex processing on very large datasets of any audio or video assets with a plug-in architecture, a secure scalable backend and an extensible dynamic web frontend. Some usecases: scaled audio computing (filtering, machine learning, etc), web audio visualization, audio process prototyping, realtime and on-demand transcoding and streaming over the web, automatic segmentation and labelling synchronized with audio events
6
6
7
-
Because there are a lot of tools available in the Python ecosystem dedicated to music information retrieval, machine learning and data analysis, we have decided to embed all main ones: Aubio\cite{aubio}, Yaafe\cite{yaafe_ISMIR2010}, Essentia\cite{essentia}, VAMP\cite{vamp-plugins}, librosa\cite{librosa}, GStreamer, TensorFlow, Torch, PyTorch, scikit-learn, Jupyter, Pandas and Pytables. They are used to develop native TimeSide plugins though its simple processing API.
7
+
Because there are a lot of tools available in the Python ecosystem dedicated to music information retrieval, machine learning and data analysis, we have decided to embed all main ones: Aubio, Yaafe, Essentia, VAMP, librosa, GStreamer, TensorFlow, Torch, PyTorch, scikit-learn, Jupyter, Pandas and Pytables. They are used to develop native TimeSide plugins though its simple processing API.
Copy file name to clipboardExpand all lines: docs/source/intro.rst
+26-19Lines changed: 26 additions & 19 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,39 +5,46 @@ TimeSide : scalable audio processing framework and server written in Python
5
5
TimeSide is a python framework enabling low and high level audio analysis, imaging, transcoding, streaming and labelling. Its high-level API is designed to enable complex processing on very large datasets of any audio or video assets with a plug-in architecture, a secure scalable backend and an extensible dynamic web frontend.
6
6
7
7
8
+
Introduction
9
+
=============
10
+
11
+
As the number of online audio applications and datasets increase, it becomes crucial for researchers and engineers to be able to prototype and test their own algorithms as fast as possible on various platforms and usecases like computational musicology and streaming services. On the other side, content providers and producers need to enhance user experiences on their platforms with more metadata based on cultural history but also audio feature analyses. Growing those metadata synchronously with the music published on the internet implies that the analysis and storage systems can be easily updated, scaled and deployed.
12
+
13
+
TimeSide has been developed in this sense to propose an online audio processing service. It provides a REST API as well as a javascript SDK so that web developers can easily embed the service into their own applications without requesting to much local resources on the user side to compute audio features.
- Realtime and on-demand transcoding and streaming over the web
22
+
- Automatic segmentation and labelling synchronized with audio events
16
23
17
24
18
25
Goals
19
26
=====
20
27
21
-
* **Do** asynchronous and fast audio processing with Python,
22
-
* **Decode** audio frames from **any** audio or video media format into numpy arrays,
23
-
* **Analyze** audio content with some state-of-the-art audio feature extraction libraries like Aubio, Yaafe and VAMP as well as some pure python processors
24
-
* **Visualize** sounds with various fancy waveforms, spectrograms and other cool graphers,
25
-
* **Transcode** audio data in various media formats and stream them through web apps,
26
-
* **Serialize** feature analysis data through various portable formats,
27
-
* **Provide** audio sources from plateform like YouTube or Deezer
28
-
* **Deliver** analysis and transcode on provided or uploaded tracks over the web through a REST API
29
-
* **Playback** and **interact** **on demand** through a smart high-level HTML5 extensible player,
30
-
* **Index**, **tag** and **annotate** audio archives with semantic metadata (see `Telemeta <http://telemeta.org>`__ which embed TimeSide).
31
-
* **Deploy** and **scale** your own audio processing engine through any infrastructure
28
+
- **Do*- asynchronous and fast audio processing with Python,
29
+
- **Decode*- audio frames from **any*- audio or video media format into numpy arrays,
30
+
- **Analyze*- audio content with some state-of-the-art audio feature extraction libraries like Aubio, Yaafe and VAMP as well as some pure python processors
31
+
- **Visualize*- sounds with various fancy waveforms, spectrograms and other cool graphers,
32
+
- **Transcode*- audio data in various media formats and stream them through web apps,
33
+
- **Serialize*- feature analysis data through various portable formats,
34
+
- **Provide*- audio sources from plateform like YouTube or Deezer
35
+
- **Deliver*- analysis and transcode on provided or uploaded tracks over the web through a REST API
36
+
- **Playback*- and **interact*- **on demand*- through a smart high-level HTML5 extensible player,
37
+
- **Index**, **tag*- and **annotate*- audio archives with semantic metadata (see `Telemeta <http://telemeta.org>`__ which embed TimeSide).
38
+
- **Deploy*- and **scale*- your own audio processing engine through any infrastructure
32
39
33
40
34
41
Funding and support
35
42
===================
36
43
37
44
To fund the project and continue our fast development process, we need your explicit support. So if you use TimeSide in production or even in a development or experimental setup, please let us know by:
38
45
39
-
* staring or forking the project on `GitHub <https://github.com/Parisson/TimeSide>`_
40
-
* tweeting something to `@parisson_studio <https://twitter.com/parisson_studio>`_ or `@telemeta <https://twitter.com/telemeta>`_
41
-
* drop us an email on <support@parisson.com> or <pow@ircam.fr>
46
+
- staring or forking the project on `GitHub <https://github.com/Parisson/TimeSide>`_
47
+
- tweeting something to `@parisson_studio <https://twitter.com/parisson_studio>`_ or `@telemeta <https://twitter.com/telemeta>`_
48
+
- drop us an email on <support@parisson.com> or <pow@ircam.fr>
0 commit comments