Difference between revisions of "Developers"

From MOD Wiki
Jump to navigation Jump to search
m (space requirement, example build folder corrected)
 
(24 intermediate revisions by 2 users not shown)
Line 1: Line 1:
The MOD Duo and Duo X units run a highly-optimized Linux embed system, using JACK as audio server and loading plugins in LV2 format.<br>
+
All the MOD units run a highly-optimized Linux embed system, using JACK as audio server and loading plugins in LV2 format.<br>
Plugin parameters can be controlled via the units' built-in knobs and footswitches, via MIDI CC and Pitchbend or via Control Chain devices.
+
Plugin parameters can be controlled via the units' built-in knobs and footswitches, via MIDI CC and Pitchbend or via Control Chain devices.<br>
 +
They can also be modulated with CV output ports, either provided by a plugin or the Duo X physical inputs.
  
 
== Technical information ==
 
== Technical information ==
  
The MOD Duo runs the Linux kernel version 3.4, with real-time patch. Running in a ARMv7 32bit OS.<br>
+
The MOD Duo runs the Linux kernel version 5.10, running in a ARMv7 32bit OS built with GCC4.9 and glibc 2.21.<br>
The MOD Duo X runs version 4.9, also with real-time patch. Running in a ARMv8a 64bit OS.
+
The MOD Duo X runs kernel version 4.4, in a ARMv8a 64bit OS built with GCC4.9 and glibc 2.21.<br>
 +
The MOD Dwarf runs kernel version 5.10, in a ARMv8a 64bit OS built with GCC7.5 and glibc 2.27.<br>
 +
All units have the real-time patch applied for the kernel build.
  
ALSA is used for the audio driver.
+
ALSA is used for the i2s audio driver.<br>
JACK runs inside as audio server backend, with mod-host loading each LV2 plugin as a new (internal) JACK client.
+
[https://github.com/moddevices/jack2 JACK] runs inside as audio server backend, with [https://github.com/moddevices/mod-host mod-host] loading each LV2 plugin as a new (internal) JACK client.<br>
mod-ui is the web server, it talks to mod-host over a unix socket.
+
[https://github.com/moddevices/mod-ui mod-ui] is the web server, it talks to [https://github.com/moddevices/mod-host mod-host] over a unix socket.<br>
 +
[https://github.com/moddevices/mod-ui mod-ui] is the one that owns the loaded project/session, with [https://github.com/moddevices/mod-host mod-host] acting as a dumb host that only does as commanded.
  
 
There's no X11 or any other kind of graphical interface. In fact, X11 libs are not even available.<br>
 
There's no X11 or any other kind of graphical interface. In fact, X11 libs are not even available.<br>
Line 15: Line 19:
 
[[Access_MOD_using_SSH|SSH is open by default]].
 
[[Access_MOD_using_SSH|SSH is open by default]].
  
The MOD Duo CPU is a dual-core Cortex A7, running at a constant 912 MHz. It is possible to set the speed to 1.0GHz, but with the risk of stability issues.<br>
+
The MOD Duo CPU is a dual-core Cortex A7, running at a constant 912 MHz.<br>
The MOD Duo X CPU is a quad-core Cortex A53, running at a constant 1.5GHz.
+
The MOD Duo X CPU is a big-little 4x Cortex A53 and 2x Cortex A72, with the A53 cores running at 1.4GHz and the A72 cores running at 1.6GHz (constant values).<br>
 +
The MOD Dwarf CPU is a quad-core Cortex A35, running at a constant 1.3GHz (or 1.2GHz if "ground loop noise reduction" mode activated).
  
The compiler is GCC 4.9.
+
The compiler is GCC 4.9 on Duo and Duo X, GCC 7.5 on Dwarf.
  
 
The default compilation flags for the Duo are:
 
The default compilation flags for the Duo are:
Line 24: Line 29:
 
<code>-O3 -mcpu=cortex-a7 -mtune=cortex-a7 -mfpu=neon-vfpv4 -mfloat-abi=hard -mvectorize-with-neon-quad</code>
 
<code>-O3 -mcpu=cortex-a7 -mtune=cortex-a7 -mfpu=neon-vfpv4 -mfloat-abi=hard -mvectorize-with-neon-quad</code>
  
And the flags for Duo X are:
+
For the Duo X the flags are:
  
 
<code>-O3 -mcpu=cortex-a53 -mtune=cortex-a53</code>
 
<code>-O3 -mcpu=cortex-a53 -mtune=cortex-a53</code>
 +
 +
And for the Dwarf:
 +
 +
<code>-O3 -mcpu=cortex-a35 -mtune=cortex-a35</code>
  
 
(Note: 64bit ARM compilers do not use 'fpu' flags, as their usage is implied)
 
(Note: 64bit ARM compilers do not use 'fpu' flags, as their usage is implied)
Line 34: Line 43:
 
<code>-ffast-math -fprefetch-loop-arrays -funroll-loops -funsafe-loop-optimizations</code>
 
<code>-ffast-math -fprefetch-loop-arrays -funroll-loops -funsafe-loop-optimizations</code>
  
Building binaries for the MOD Duo can be easily done using the [https://github.com/moddevices/mod-plugin-builder mod-plugin-builder].
+
Building binaries for them can be easily done using the [https://github.com/moddevices/mod-plugin-builder mod-plugin-builder].
  
 
Apart from programming software in a "traditional" way, it's also possible to generate audio plugins for the MOD from gen~ objects created in Cycling '74 Max.  
 
Apart from programming software in a "traditional" way, it's also possible to generate audio plugins for the MOD from gen~ objects created in Cycling '74 Max.  
 
See the [[Max_gen~]] page for more details.
 
See the [[Max_gen~]] page for more details.
  
== Useful links ==
+
== Plugin Development ==
  
These are useful links for general information regarding developing audio plugins and realtime software.
+
See the dedicated [[Creating Audio Plugins]] page for this topic.
  
* [http://www.rossbencina.com/code/real-time-audio-programming-101-time-waits-for-nothing Real-time audio programming 101: time waits for nothing]
+
Building plugins can be done with mod-plugin-builder.
* [http://lv2plug.in/book/ Programming LV2 Plugins]
 
  
Please note that it is also possible to build LV2 plugins using [http://distrho.github.io/DPF/ DPF] or [https://docs.juce.com/ Juce].
+
=== mod-plugin-builder ===
Building with those frameworks is not yet documented though, please reach out to us if interested on the subject.
 
  
== mod-plugin-builder ==
+
The [https://github.com/moddevices/mod-plugin-builder mod-plugin-builder] is a custom build system that gives developers a similar system to what's available inside the MOD units.<br>
 
 
The [https://github.com/moddevices/mod-plugin-builder mod-plugin-builder] is a custom build system that gives developers a similar system to what's available inside the Duo.<br>
 
 
We do not recommend the use of a regular Linux ARM system or compiler, as it might lead to issues due to mismatching library versions.
 
We do not recommend the use of a regular Linux ARM system or compiler, as it might lead to issues due to mismatching library versions.
  
Line 63: Line 68:
 
$ cd mod-plugin-builder
 
$ cd mod-plugin-builder
 
$ ./bootstrap.sh <platform>
 
$ ./bootstrap.sh <platform>
$ # Where platform can be modduo or modduox
+
$ # Where platform can be modduo, modduox or moddwarf
 +
$ # NEW: You can use modduo-static or modduox-static as platform if GCC4.9 is too old, these special targets will use GCC7.5 similar to the Dwarf
 
</source>
 
</source>
  
 
This process should take at least 1 hour, probably more depending on your CPU.<br/>
 
This process should take at least 1 hour, probably more depending on your CPU.<br/>
Assuming your source code is cross-compile friendly (ie, no hardcoded compiler and paths and uses pkg-config to find extra libraries), the compiler setup is as simple as: (adjust as needed)
+
If you are lacking on time or disk space (needed ~15G) you can use "minimal" as argument after the platform which will only build the compiler and the bare minimum libraries.
 +
 
 +
Assuming your source code is cross-compilation friendly (ie, no hardcoded compiler and paths and uses pkg-config to find extra libraries), the compiler setup is as simple as: (adjust as needed)
  
 
<source lang="console">
 
<source lang="console">
Line 78: Line 86:
  
 
The local.env file will setup your Linux compiler environment variables (such as CC, CXX, CFLAGS, etc) to use mod-plugin-builder files.<br/>
 
The local.env file will setup your Linux compiler environment variables (such as CC, CXX, CFLAGS, etc) to use mod-plugin-builder files.<br/>
If everything goes well, the resulting binaries will be ARMv7, MOD Duo compatible.
+
If everything goes well, the resulting binaries will be compatible with the target platform.
  
=== Quick example plugin ===
+
==== Quick example plugin ====
  
 
A quick example plugin is available inside mod-plugin-builder in plugins/package/eg-amp-lv2/source/, which works with this cross-compilation setup.<br/>
 
A quick example plugin is available inside mod-plugin-builder in plugins/package/eg-amp-lv2/source/, which works with this cross-compilation setup.<br/>
See https://github.com/moddevices/mod-plugin-builder/tree/master/plugins/package/eg-amp-lv2/source
+
See https://github.com/moddevices/mod-plugin-builder/tree/master/plugins/package/eg-amp-lv2-labs/source
  
Building this example plugin can be done like so:
+
Building this example plugin can be done like so: (adjust as needed)
  
 
<source lang="console">
 
<source lang="console">
$ source ~/mod-plugin-builder/local.env
+
$ cd ~/mod-plugin-builder/
$ make -C ~/mod-plugin-builder/plugins/package/eg-amp-lv2/source
+
$ source local.env modduo
 +
$ cd ~/mod-plugin-builder/plugins/package/eg-amp-lv2-labs/source/
 +
$ make
 
</source>
 
</source>
  
Line 96: Line 106:
 
== Deploying plugins ==
 
== Deploying plugins ==
  
You can push an LV2 plugin bundle to the MOD Duo via command-line, using curl, by running this: (adjust as needed)
+
You can push an LV2 plugin bundle to a MOD unit via command-line, using curl, by running this: (adjust as needed)
  
 
<source lang="console">
 
<source lang="console">
Line 103: Line 113:
 
</source>
 
</source>
  
That's it! Your plugin is now inside the Duo!
+
That's it! Your plugin is now inside the unit!
  
 
To those curious ones, the last command packs the eg-amp.lv2 into a tar.gz file, encodes it as base64 and then sends it to a special URL that the MOD unit uses to install plugin tarballs.
 
To those curious ones, the last command packs the eg-amp.lv2 into a tar.gz file, encodes it as base64 and then sends it to a special URL that the MOD unit uses to install plugin tarballs.
Line 109: Line 119:
 
== APIs and Documentation ==
 
== APIs and Documentation ==
  
=== Linux ===
+
=== LV2 ===
 +
 
 +
Audio and MIDI plugins in MOD Devices are done in LV2 format.<br>
 +
MOD provides custom LV2 extensions (for MOD specific data and HTML interfaces).
  
Being Linux, developers have access to UNIX and POSIX APIs.<br>
+
See our [[LV2]] page for more information on how LV2 is integrated in MOD.
This means <unistd.h>, <pthread.h> and <stdlib.h> for example.
 
  
For more information see:
+
For reference/external information see:
* https://www.kernel.org/doc/man-pages/
+
* http://lv2plug.in/pages/developing.html
* http://pubs.opengroup.org/onlinepubs/9699919799/functions/contents.html
+
* https://moddevices.github.io/mod-sdk/mod/
 +
* https://moddevices.github.io/mod-sdk/modgui/
  
 
=== JACK ===
 
=== JACK ===
Line 128: Line 141:
 
NOTE: All MOD units use JACK2.
 
NOTE: All MOD units use JACK2.
  
=== LV2 ===
+
=== Linux ===
  
Audio and MIDI plugins in MOD Devices are done in LV2 format.<br>
+
Being Linux, developers have access to UNIX and POSIX APIs.<br>
MOD provides custom LV2 extensions (for MOD specific data and HTML interfaces).
+
This means <unistd.h>, <pthread.h> and <stdlib.h> for example.
  
 
For more information see:
 
For more information see:
* http://lv2plug.in/pages/developing.html
+
* https://www.kernel.org/doc/man-pages/
* https://moddevices.github.io/mod-sdk/mod/
+
* http://pubs.opengroup.org/onlinepubs/9699919799/functions/contents.html
* https://moddevices.github.io/mod-sdk/modgui/
 
  
 
=== Toolchain ===
 
=== Toolchain ===
Line 150: Line 162:
 
* binutils 2.26.1
 
* binutils 2.26.1
  
We are working to bring the same GCC 7.5 to the Duo and Duo X as optional build target, while keeping the same glibc and binutils.
+
Note: Within mod-plugin-builder you can use "modduo-static" or "modduox-static" as platform to get GCC7.5 and binutils 2.26.1.<br>
 +
The glibc version will remain the same though, for backwards compatibility.
  
 
=== Libraries ===
 
=== Libraries ===
  
The following libraries are available inside the Duo:
+
The following libraries are available inside the MOD units:
 
* acl
 
* acl
 
* alsa
 
* alsa
Line 173: Line 186:
 
* glibc (v2.21)
 
* glibc (v2.21)
 
* icu
 
* icu
* jack
+
* jack2
 
* libffi
 
* libffi
 
* libgig
 
* libgig
Line 212: Line 225:
 
* Xrun counter (a.k.a. audio drop-outs)
 
* Xrun counter (a.k.a. audio drop-outs)
  
== Beta/Unstable plugins ==
+
Developer mode can be enabled on the settings page: http://192.168.51.1/settings.
 +
 
 +
== Useful links ==
  
By default unstable plugins are hidden in the plugin store; however they can be made visible for use within pedalboards.
+
These are useful links for general information regarding developing audio plugins and realtime software.
  
There is an option on the special settings page: http://192.168.51.1/settings.
+
* [http://www.rossbencina.com/code/real-time-audio-programming-101-time-waits-for-nothing Real-time audio programming 101: time waits for nothing]
 +
* [http://lv2plug.in/book/ Programming LV2 Plugins]
  
NOTE: Do not report bugs when using unstable plugins.<br/>
+
Please note that it is also possible to build LV2 plugins using [http://distrho.github.io/DPF/ DPF] or [https://docs.juce.com/ Juce].
They have not been curated or tested, so they might corrupt memory or even crash.<br/>
+
Building with those frameworks is not yet documented though, please reach out to us if interested on the subject.
Use with caution.
 
  
 
== USB Device Support ==
 
== USB Device Support ==

Latest revision as of 15:19, 4 March 2022

All the MOD units run a highly-optimized Linux embed system, using JACK as audio server and loading plugins in LV2 format.
Plugin parameters can be controlled via the units' built-in knobs and footswitches, via MIDI CC and Pitchbend or via Control Chain devices.
They can also be modulated with CV output ports, either provided by a plugin or the Duo X physical inputs.

Technical information

The MOD Duo runs the Linux kernel version 5.10, running in a ARMv7 32bit OS built with GCC4.9 and glibc 2.21.
The MOD Duo X runs kernel version 4.4, in a ARMv8a 64bit OS built with GCC4.9 and glibc 2.21.
The MOD Dwarf runs kernel version 5.10, in a ARMv8a 64bit OS built with GCC7.5 and glibc 2.27.
All units have the real-time patch applied for the kernel build.

ALSA is used for the i2s audio driver.
JACK runs inside as audio server backend, with mod-host loading each LV2 plugin as a new (internal) JACK client.
mod-ui is the web server, it talks to mod-host over a unix socket.
mod-ui is the one that owns the loaded project/session, with mod-host acting as a dumb host that only does as commanded.

There's no X11 or any other kind of graphical interface. In fact, X11 libs are not even available.

SSH is open by default.

The MOD Duo CPU is a dual-core Cortex A7, running at a constant 912 MHz.
The MOD Duo X CPU is a big-little 4x Cortex A53 and 2x Cortex A72, with the A53 cores running at 1.4GHz and the A72 cores running at 1.6GHz (constant values).
The MOD Dwarf CPU is a quad-core Cortex A35, running at a constant 1.3GHz (or 1.2GHz if "ground loop noise reduction" mode activated).

The compiler is GCC 4.9 on Duo and Duo X, GCC 7.5 on Dwarf.

The default compilation flags for the Duo are:

-O3 -mcpu=cortex-a7 -mtune=cortex-a7 -mfpu=neon-vfpv4 -mfloat-abi=hard -mvectorize-with-neon-quad

For the Duo X the flags are:

-O3 -mcpu=cortex-a53 -mtune=cortex-a53

And for the Dwarf:

-O3 -mcpu=cortex-a35 -mtune=cortex-a35

(Note: 64bit ARM compilers do not use 'fpu' flags, as their usage is implied)

For aggressive optimization, add these:

-ffast-math -fprefetch-loop-arrays -funroll-loops -funsafe-loop-optimizations

Building binaries for them can be easily done using the mod-plugin-builder.

Apart from programming software in a "traditional" way, it's also possible to generate audio plugins for the MOD from gen~ objects created in Cycling '74 Max. See the Max_gen~ page for more details.

Plugin Development

See the dedicated Creating Audio Plugins page for this topic.

Building plugins can be done with mod-plugin-builder.

mod-plugin-builder

The mod-plugin-builder is a custom build system that gives developers a similar system to what's available inside the MOD units.
We do not recommend the use of a regular Linux ARM system or compiler, as it might lead to issues due to mismatching library versions.

If you're running Linux just clone MOD Plugin Builder and follow the instructions.
For other operating systems you will need something like docker desktop, more details here.

In summary:

$ git clone https://github.com/moddevices/mod-plugin-builder
$ cd mod-plugin-builder
$ ./bootstrap.sh <platform>
$ # Where platform can be modduo, modduox or moddwarf
$ # NEW: You can use modduo-static or modduox-static as platform if GCC4.9 is too old, these special targets will use GCC7.5 similar to the Dwarf

This process should take at least 1 hour, probably more depending on your CPU.
If you are lacking on time or disk space (needed ~15G) you can use "minimal" as argument after the platform which will only build the compiler and the bare minimum libraries.

Assuming your source code is cross-compilation friendly (ie, no hardcoded compiler and paths and uses pkg-config to find extra libraries), the compiler setup is as simple as: (adjust as needed)

$ pushd ~/mod-plugin-builder/
$ source local.env <platform>
$ popd
$ # cmake, waf configure, ./configure, etc
$ make

The local.env file will setup your Linux compiler environment variables (such as CC, CXX, CFLAGS, etc) to use mod-plugin-builder files.
If everything goes well, the resulting binaries will be compatible with the target platform.

Quick example plugin

A quick example plugin is available inside mod-plugin-builder in plugins/package/eg-amp-lv2/source/, which works with this cross-compilation setup.
See https://github.com/moddevices/mod-plugin-builder/tree/master/plugins/package/eg-amp-lv2-labs/source

Building this example plugin can be done like so: (adjust as needed)

$ cd ~/mod-plugin-builder/
$ source local.env modduo
$ cd ~/mod-plugin-builder/plugins/package/eg-amp-lv2-labs/source/
$ make

After this the eg-amp.lv2 bundle is ready to be deployed into a MOD unit.

Deploying plugins

You can push an LV2 plugin bundle to a MOD unit via command-line, using curl, by running this: (adjust as needed)

$ cd ~/mod-plugin-builder/plugins/package/eg-amp-lv2/source/
$ tar cz eg-amp.lv2 | base64 | curl -F 'package=@-' http://192.168.51.1/sdk/install

That's it! Your plugin is now inside the unit!

To those curious ones, the last command packs the eg-amp.lv2 into a tar.gz file, encodes it as base64 and then sends it to a special URL that the MOD unit uses to install plugin tarballs.

APIs and Documentation

LV2

Audio and MIDI plugins in MOD Devices are done in LV2 format.
MOD provides custom LV2 extensions (for MOD specific data and HTML interfaces).

See our LV2 page for more information on how LV2 is integrated in MOD.

For reference/external information see:

JACK

Also known as Jack Audio Connection Kit, is the audio server running inside the MOD.
Developers can create JACK clients to interact with the audio data directly (without being managed by a plugin host).

For more information see:

NOTE: All MOD units use JACK2.

Linux

Being Linux, developers have access to UNIX and POSIX APIs.
This means <unistd.h>, <pthread.h> and <stdlib.h> for example.

For more information see:

Toolchain

As of release 1.10, the MOD Duo and MOD Duo X uses:

  • GCC 4.9
  • glibc 2.21
  • binutils 2.25

While the MOD Dwarf uses:

  • GCC 7.5
  • glibc 2.27
  • binutils 2.26.1

Note: Within mod-plugin-builder you can use "modduo-static" or "modduox-static" as platform to get GCC7.5 and binutils 2.26.1.
The glibc version will remain the same though, for backwards compatibility.

Libraries

The following libraries are available inside the MOD units:

  • acl
  • alsa
  • armadillo
  • audiofile
  • boost
  • cairo
  • dbus
  • expat
  • fftw/fftwf (v3.3.5 on Duo, v3.3.8 on Duo X and Dwarf)
  • ffmpeg
  • flac
  • fluidsynth
  • fontconfig
  • freetype
  • gio/giomm
  • glib/glibmm
  • glibc (v2.21)
  • icu
  • jack2
  • libffi
  • libgig
  • libjpeg/libturbojpeg
  • liblo
  • libogg
  • libpng
  • libsamplerate
  • libsigc
  • libsndfile
  • libvorbis
  • libxml2
  • lilv
  • lvtk (v1 and v2)
  • mxml
  • ncurses
  • ne10
  • pcre
  • pixman
  • python (v3.4)
  • qt5 (core, network, sql and xml)
  • readline
  • sdl
  • serd
  • sord
  • sratom
  • systemd (v219)
  • zita-convolver
  • zita-resampler

Developer mode

MOD's web interface has some hidden features, not really useful for users but useful for developers.
This includes:

  • Buffer size change (128 or 256 frames per cycle)
  • Install-All button in plugin store
  • Network statistics
  • Xrun counter (a.k.a. audio drop-outs)

Developer mode can be enabled on the settings page: http://192.168.51.1/settings.

Useful links

These are useful links for general information regarding developing audio plugins and realtime software.

Please note that it is also possible to build LV2 plugins using DPF or Juce. Building with those frameworks is not yet documented though, please reach out to us if interested on the subject.

USB Device Support

  • Most USB-MIDI devices (if they are class-compliant, they should just work)
  • Arduino running MocoLufa firmware (to create midi-controllers)
  • PlayStation 3 and 4 Controllers
  • Guitar Hero Controller (Red Octane Xbox version)
  • Any regular joystick

Hardware Specification

MOD Duo

CPU:

  • Dual Core ARMv7 1.0GHz
  • 4GB Flash Storage, 1GB RAM

AUDIO CODEC:

  • Cirrus Logic, 24 bit / 48 kHz AD/DA
  • DAC/ADC: 104dB Dynamic Range. -90dB THD+N

CONTROLLER:

  • 2 knobs with LCD screen
  • 2 foot switches with color LEDs

I/O CONNECTIONS:

  • MIDI IN/OUT – Standard DIN 5 pins
  • Control Chain – RJ45 connector – for additional controllers
  • USB HOST – USB 2.0 Standard-A type, supporting: USB Bluetooth and USB MIDI
  • USB DEVICE – USB 2.0 Standard-B type, supporting: USB Ethernet Connection

MOD DuoX

CPU:

  • A53 quad core 1.4 GHz + A72 dual core 2 GHz
  • 16GB Flash Storage, 2GB RAM

AUDIO CODEC:

  • Cirrus Logic, 24 bit / 48 kHz AD/DA
  • DAC/ADC: 104dB Dynamic Range. -90dB THD+N

CONTROLLER:

  • 2 knobs with LCD screens
  • 7 push buttons with color LEDs
  • 8 analog potentiometers

I/O CONNECTIONS:

  • MIDI IN/OUT – Standard DIN 5 pins
  • Control Chain – RJ45 connector – for additional controllers
  • USB HOST – USB 2.0 Standard-A type, supporting: USB Bluetooth and USB MIDI
  • USB DEVICE – USB 2.0 Standard-B type, supporting: USB Ethernet Connection
  • Control Voltage IN/OUT – 0 to 10 volt – for connecting to analog gear
  • SPDIF output – 3.5mm-jack – for digital audio output