MusiKraken 1.64

MusiKraken is an Experimental MIDI Controller Construction Kit.

Recipient of the 2022 MIDI Innovation Awards in the category "Software Prototypes / Non-Commercial Products".

Create music by utilizing device sensors such as Touch, Accelerometer, Microphone, and Camera (includes support for face, hand, body joint tracking, color tracking, and depth sensors), or connected devices like Game Controllers or an Apple Watch.

Choose from a variety of modules in the editor to design and connect ports for a customized MIDI controller arrangement. Route MIDI signals through effect modules enabling control over multiple instruments concurrently or leading to inventive combinations.

MusiKraken facilitates the transmission and reception of MIDI data via Wi-Fi, Bluetooth, or Core MIDI (e.g., using Inter-Device Audio and MIDI (IDAM)), and can host Audio Unit Instruments.

Note: Some modules are exclusively compatible with iOS devices featuring specific hardware requirements: ARKit Face Tracking and the TrueDepth module necessitate a TrueDepth front camera; Hand and Body Joint Tracking require at least iOS 14 and may lack performance on outdated devices.

Input Modules:

• Keyboard: MPE support with scale highlighting, enables control of multiple values through sliding, touch pressure, or finger radius.
• Chords Pad: Play chords and their inversions within a chosen scale.
• Touchpad: Utilize multiple fingers on a touchpad to control up to 5 values simultaneously.
• ARKit Face Tracking: Uses the TrueDepth camera for note generation or parameter control via mouth, eyes, tongue movements, or head gestures.
• Mouth Tracking: Controls parameters using the device's standard camera.
• TrueDepth: Generates MIDI data from depth signals captured by the camera; allows movement-based control in front of the device.
• Hand Tracking: Converts hand position and gestures into MIDI data using the camera; supports one or two hands and integrates TrueDepth sensor functionalities when available.
• Body Tracking: Tracks hand, feet, and head positions of up to two individuals using the camera.
• Color Tracking: Object tracking via color recognition.
• Motion Sensors: Utilizes Accelerometer, Gyroscope, and Magnetometer combination to determine device rotation.
• Accelerometer: Measures device acceleration.
• Apple Watch: Integrates motion sensors, heart rate monitor, touch functionality, and digital crown input.
• Game Controller: Control through buttons, thumbsticks, and additional features.
• Microphone: Detects pitch and volume via microphone input.
• External Input Device: Receives MIDI events from connected input devices.

Output Modules:

• External Output Device: Sends MIDI events to any Core MIDI accessible device.
• AudioUnit: Loads Music Device or MIDI Processor Audio Units to create sounds within the app.
• Core MIDI Network: Transmission of MIDI over Wi-Fi network.
• Snarp Network MIDI: Proprietary implementation for wireless MIDI transfer.
• SimpleSynth: Generates basic synthesizer sounds directly on the device.

Effects:

• Chord Splitter: Segregates incoming chords into individual notes distributed across separate channels.
• Channel Switcher: Alters the MIDI channel of events.
• Value to MIDI Converter: Converts numerical values (green ports) into MIDI events (orange ports).
• Transposer: Transposes MIDI notes.
• Arpeggiator: Cycles through incoming chord notes using a specified pattern.
• Speed: Computes new values based on the speed of change in another value.
• Beat: Initiates a beat upon rapid value alteration.
• Threshold: Activates notes when a value surpasses a specific threshold.
• LFO: Produces an LFO based on incoming values.
• Envelope: Generats ADSR output derived from note input.
• Latch: Maintains note sustain until the same note is replayed.
• Filter: Filters events by channel, note, velocity, or CC values.

The app incorporates HealthKit for Apple Watch data access including heart rate monitoring and motion sensor data. Sensor data is exclusively employed for MIDI event generation within the application.