★ audiocommander
                  Audio ·· · Media ···· ·  · Space ···· ·  ·   ·    ·     ·      ·       ·        ·          ·
  • Home
  • Exhibitions
  • Portfolio (new!)
  • Projekte/Werke
    • Arts/Kunst
    • Electronics
    • Music
    • Programming
    • Software
    • Teaching
  • Vita
  • Forums
  • Kontakt
  • Impressum
  • Home
  • Exhibitions
  • Portfolio (new!)
  • Projekte/Werke
    • Arts/Kunst
    • Electronics
    • Music
    • Programming
    • Software
    • Teaching
  • Vita
  • Forums
  • Kontakt
  • Impressum
  • Home
  • /
  • Articles in English
  • /
  • Electronics
  • /
  • Music
  • /
  • Programming
  • /
  • Software

Kempelen 2.0

I just released an application interface “kII” to control the SpeakJet, an integrated robot-voice soundchip from Magnevation, by MIDI.
Some of the features include Jaw-/Tongue-Position Control, Note-pitched voicings, subtractive synthesis built up with the SpeakJet’s five oscillators as well as a small integrated harmonizer module. You can set up a base note and a scale and have therefore absolute control!

kII stands for “Kempelen Two”: Baron Wolfang von Kempelen has been a hungarian inventor and creator of famous automats. Whereas his most famous creatin has been the “Turkish Chessplayer” (which was a late-revealed fake with a chess-player sitting inside), he also invented one of the first talking machines ever. Baron Kempelen lived from 1734 to 1804.

I released all plans and software on midibox.org. You will also find dedicated DIY-building instructions for the needed IIC-SpeakJet-Module and a Core-Module. midibox.org is a DIY-Community founded by Thorsten Klose who released MBHP and MIOS under an open license that forbids commercial use. Please be fair and respect that.

The main goal for the development is not the generation of words or true speech, rather than an experimental approach to generate an interactive musical interface for phonetic experiences.
Watch out for future project descriptions!

If you are improving the application, please contact me or add a comment on this page, so I can update the project!

MBHP SpeakJet ModuleApplication LCD Output

 
Features:
· Full MSA and SCP Control via Midi!
· Trigger Allophones and SoundFX by Notes
· Trigger Allophones only by Notes
· Trigger SoundFX only by Notes
· Jaw/Tongue control: set position of jaw and tongue by CC, play pitched Allophone by Notes
· Different Jaw/Tongue sets available: Vowels/Consonants/Pauses
· Change the pitch of currently played Allophones by Notes 0..59
· Play the 5 Oscillators by Notes, one OSC per Channel
· Harmonic subtractive syntesis Multi-OSC playmode by Notes(!)
· Control Waveforms (shapes) of harmonic synthesis Multi-OSC mode
· Change Allophone Pitch by using the 14bit PitchBend-Wheel
· Control Bend with CH_AFTERTOUCH
· Control Speed by CC
· Control Master Volume by CC
· Send Pauses by CC
· Send Next Slow/High/Low/Fast by CC
· Control OSC-Frquencies and Levels by CC
· Control ENV-Frequency and Type by CC
· Control Distortion (OSC 4 & 5) by CC
· Fire Phrases by CC
· Supports System Realtime Messages START, STOP, CONTINUE, RESET
· Send PANIC by Foot & AllNotes/SoundsOFF Messages
· Custom assignable controls by editing the definition listing (IIC_SpeakJetMidiDefines.h)

 
Download:
· Download and Documentation on midibox.org

Audio-Example:
http://www.audiocommander.de/downloads/midibox/SpeakJet_kII_03.mp3

Historical Background:
· Androids Automated Smalltalks

Links:
· SpeakJet Breadboard Construction Tutorial by audiocommander
· Circuit (PDF)

Related Projects:
· m5 sensorizer
· Programming Microchips with a Mac
· My User-page on midibox.org

 

Posted on 5. December 2006 by audiocommander. This entry was posted in Articles in English, Electronics, Music, Programming, Software and tagged Android, Circuit, Gestures, Hardware, Interactive, Kempelen, kII, LIVE, Microchip, Midi, midibox, Phonetic, Sensor, Software, Sonic, SpeakJet, Speech, Sprechautomat, Touch. Bookmark the permalink.
urban-research-institute.org
Proximity Detection with QT301

    Tags

    ACSensorizer AdBK Akademie Bauhaus Blaue Nacht Body Cocoa Cybersonica Exhibition Gestures Hardware History Interactive Intermedia Kempelen kII kIII Kontaktstation Licht LIVE London Mac OS X Medienkunst Midi midibox Mobile Phone Nürnberg Objective C Performance Phonetic Politik Public Art Raum Sensor Sensory Music Software Sonic SpeakJet Speech Sprechautomat Stadt Touch Ubiquitous Urban Research Institute Video

    Recent Posts

    • Phonorama Leipzig
    • I ❤ NY
    • 2nd price at Mobile HCI 2014 in Toronto
    • Going Mobile
    • Ars Electronica: Physarum Polycephalum
    • Home
    • Exhibitions
    • Portfolio (new!)
    • Projekte/Werke
      • Arts/Kunst
      • Electronics
      • Music
      • Programming
      • Software
      • Teaching
    • Vita
    • Forums
    • Kontakt
    • Impressum
This website uses cookies to improve your browsing experience. We don't use Analytics. We'll assume you're ok with this if you continue to use this website. Accept Privacy Statement / Informationen zum Datenschutz
Privacy & Cookies Policy
Powered by