EasyVR Shield 3.0 - Voice Recognition Shield for arduino

Description: EasyVR Shield 3.0 - Voice Recognition Shield for arduino Do you make time to talk to your Arduino? Maybe you should! The EasyVR Shield 3.0 is a voice recognition shield for Arduino boards integrating an EasyVR module. It includes all of the features of the EasyVR module in a shield form factor that simplifies connection to the Arduino main board and PC. EasyVR 3.0 is a multi-purpose speech recognition module designed to add versatile, robust and cost effective speech and voice recognition capabilities to virtually any application. EasyVR is the third generation version of the successful VRbot module and builds on the features and functionality of its predecessor. In addition to the EasyVR 3.0 features like up to 32 user-defined Speaker Dependent (SD) commands and 26 built-in speaker independent (SI) commands for ready to run basic controls, the shield has an additional audio line-out/headphone jack, and access to the I/O pins of the EasyVR module. Note: Unlike V2.0, the EasyVR Shield 3.0 does not come preassembled and will require some soldering and assebly before operation. Features ~ A selection of 26 built-in Speaker Independent (SI) commands (available in US English, Italian, Japanese, German, Spanish, and French) for ready to run basic controls.~ Supports up to 32 user-defined Speaker Dependent (SD) triggers or commands (any language) as well as Voice Passwords.~ With the optional Quick T2SI Lite license you can add up to 28 Speaker Independent (SI) Vocabularies, each one with up to 12 SI different commands. Therefore an overall number of up to 336 additional SI commands!~ SonicNet to control one or more EasyVR 3.0s wirelesly with sound tokens generated by the module or other sound source~ DTMF tone generation~ Easy-to-use and simple Graphical User Interface to program Voice Commands to your robot.~ Compatible with Arduino boards that have the 1.0 Shield interface (UNO R3) and legacy boards including:Arduino DuemilanoveArduino UnoArduino MegaArduino LeonardoArduino Due~ Module can be used with any host with an UART interface (powered at 3.3V - 5V).~ Supports direct connection to the PC on main boards with a separate USB/Serial chip and a special software-driven “bridge” mode on boards with only native USB interface, for easy access by the EasyVR Commander.~ Simple and robust serial protocol to access and program the module through the host board.~ Make your own sound tables using Sensory QuickSynthesis4 tool.~ Supports remapping of serial pins used by the Shield (in SW mode).~ The new EasyVR GUI includes a command to process and download custom sound tables to the module (overwriting existing sound table)~ Provides a 3.5mm audio output jack suitable for headphones or as a line out~ 8 ohm speaker output~ Access to EasyVR I/O pins~ LED to show feedback during recognition tasks~ Live message recording and Fast SD/SV recognition~ Arduino Libraries provided User Manual: /files/EasyVR%203%20User%20Manual%201.0.16.pdf @ veear website EasyVR Commander: /files/EasyVR-Commander.zip @ @ veear website Arduino Library: RoboTech-srl/EasyVR-Arduino @ github Product Page: /introducing-easyvr-3-easyvr-shield-3/ @ veear website Downloads Page: /downloads/ @ veear website Product Video: GyxdT6wTfEE @ youtube Download arduino library from here: RoboTech-srl/EasyVR-Arduino @ github and test the EasyVR board using below code: /** EasyVR Tester Dump contents of attached EasyVR module and exercise it with playback and recognition. Serial monitor can be used to send a few basic commands: '?' - display the module setup 'l' - cycles through available languages 'c' - cycles through available command groups 'b' - cycles through built-in word sets 'g' - cycles through custom grammars 's123' - play back sound 123 if available (or beep) 'd0123456789ABCD*#' - dials the specified number ('_' is dial tone) 'k' - starts detection of tokens '4' or '8' - sets token length to 4 or 8 bits 'n123' - play back token 123 (not checked for validity) 'm1' - set mic distance to HEADSET 'm2' - set mic distance to ARMS_LENGTH (default) 'm3' - set mic distance to FAR_MIC 'w' - enter sleep mode without audio wakeup (any command interrupts) 'ww' - enter sleep mode with "whistle" wakeup 'w2' - enter sleep mode with "double-clap" wakeup 'w3' - enter sleep mode with "triple-clap" wakeup 'wl' - enter sleep mode with "loud-sound" wakeup 'r12' - record message 12 if empty 'p12' - play back message 12 if recorded 'e12' - erase message 12 With EasyVR Shield, the green LED is ON while the module is listening (using pin IO1 of EasyVR). Successful recognition is acknowledged with a beep. Details are displayed on the serial monitor window. ** Example code for the EasyVR library v1.10.1 To the extent possible under law, the author(s) have dedicated all copyright and related and neighboring rights to this software to the public domain worldwide. This software is distributed without any warranty. You should have received a copy of the CC0 Public Domain Dedication along with this software. */ #include "Arduino.h" #if !defined(SERIAL_PORT_MONITOR) #error "Arduino version not supported. Please update your IDE to the latest version." #endif #if defined(__SAMD21G18A__) // Shield Jumper on HW (for Zero, use Programming Port) #define port SERIAL_PORT_HARDWARE #define pcSerial SERIAL_PORT_MONITOR #elif defined(SERIAL_PORT_USBVIRTUAL) // Shield Jumper on HW (for Leonardo and Due, use Native Port) #define port SERIAL_PORT_HARDWARE #define pcSerial SERIAL_PORT_USBVIRTUAL #else // Shield Jumper on SW (using pins 12/13 or 8/9 as RX/TX) #include "SoftwareSerial.h" SoftwareSerial port(12, 13); #define pcSerial SERIAL_PORT_MONITOR #endif #include "EasyVR.h" EasyVR easyvr(port); int8_t bits = 4; int8_t set = 0; int8_t group = 0; uint32_t mask = 0; uint8_t train = 0; int8_t grammars = 0; int8_t lang = 0; char name[33]; bool useCommands = true; bool useGrammars = false; bool useTokens = false; bool isSleeping = false; bool isBusy = false; void setup() { // setup PC serial port pcSerial.begin(9600); bridge: // bridge mode? int mode = easyvr.bridgeRequested(pcSerial); switch (mode) { case EasyVR::BRIDGE_NONE: // setup EasyVR serial port port.begin(9600); // run normally pcSerial.println(F("Bridge not requested, run normally")); pcSerial.println(F("---")); break; case EasyVR::BRIDGE_NORMAL: // setup EasyVR serial port (low speed) port.begin(9600); // soft-connect the two serial ports (PC and EasyVR) easyvr.bridgeLoop(pcSerial); // resume normally if aborted pcSerial.println(F("Bridge connection aborted")); pcSerial.println(F("---")); break; case EasyVR::BRIDGE_BOOT: // setup EasyVR serial port (high speed) port.begin(115200); pcSerial.end(); pcSerial.begin(115200); // soft-connect the two serial ports (PC and EasyVR) easyvr.bridgeLoop(pcSerial); // resume normally if aborted pcSerial.println(F("Bridge connection aborted")); pcSerial.println(F("---")); break; } // initialize EasyVR while (!easyvr.detect()) { pcSerial.println(F("EasyVR not detected!")); for (int i = 0; i < 10; ++i) { if (pcSerial.read() == EasyVR::BRIDGE_ESCAPE_CHAR) goto bridge; delay(100); } } pcSerial.print(F("EasyVR detected, version ")); pcSerial.print(easyvr.getID()); if (easyvr.getID() < EasyVR::EASYVR3) easyvr.setPinOutput(EasyVR::IO1, LOW); // Shield 2.0 LED off if (easyvr.getID() < EasyVR::EASYVR) pcSerial.print(F(" = VRbot module")); else if (easyvr.getID() < EasyVR::EASYVR2) pcSerial.print(F(" = EasyVR module")); else if (easyvr.getID() < EasyVR::EASYVR3) pcSerial.print(F(" = EasyVR 2 module")); else pcSerial.print(F(" = EasyVR 3 module")); pcSerial.print(F(", FW Rev.")); pcSerial.println(easyvr.getID() & 7); easyvr.setDelay(0); // speed-up replies if (easyvr.getID() >= EasyVR::EASYVR3_1) { if (!easyvr.checkMessages() && easyvr.getError() == EasyVR::ERR_CUSTOM_INVALID) { pcSerial.print(F("Message recovery needed, please wait...")); if (easyvr.fixMessages()) pcSerial.println(F(" done!")); else pcSerial.println(F(" failed!")); } } pcSerial.print(F("Recorded messages:")); if (easyvr.getID() >= EasyVR::EASYVR3_1) { pcSerial.println(); for (int8_t idx = 0; idx < 32; ++idx) { int8_t bits = -1; int32_t len = -1; easyvr.dumpMessage(idx, bits, len); if ((bits == 0) && (len == 0)) continue; // skip empty pcSerial.print(idx); pcSerial.print(F(" = ")); if (bits < 0 || len < 0) pcSerial.println(F(" has errors")); else { pcSerial.print(bits); pcSerial.print(F(" bits, size ")); pcSerial.println(len); } } } else pcSerial.println(F("n/a")); easyvr.setTimeout(5); lang = EasyVR::ENGLISH; easyvr.setLanguage(lang); // use fast recognition easyvr.setTrailingSilence(EasyVR::TRAILING_MIN); easyvr.setCommandLatency(EasyVR::MODE_FAST); int16_t count = 0; pcSerial.print(F("Sound table: ")); if (easyvr.dumpSoundTable(name, count)) { pcSerial.println(name); pcSerial.print(F("Sound entries: ")); pcSerial.println(count); } else pcSerial.println(F("n/a")); pcSerial.print(F("Custom Grammars: ")); grammars = easyvr.getGrammarsCount(); if (grammars > 4) { pcSerial.println(grammars - 4); for (set = 4; set < grammars; ++set) { pcSerial.print(F("Grammar ")); pcSerial.print(set); uint8_t flags, num; if (easyvr.dumpGrammar(set, flags, num)) { pcSerial.print(F(" has ")); pcSerial.print(num); if (flags & EasyVR::GF_TRIGGER) pcSerial.println(F(" trigger")); else pcSerial.println(F(" command(s)")); } else { pcSerial.println(F(" error")); continue; } for (int8_t idx = 0; idx < num; ++idx) { pcSerial.print(idx); pcSerial.print(F(" = ")); if (!easyvr.getNextWordLabel(name)) break; pcSerial.println(name); } } } else pcSerial.println(F("n/a")); if (easyvr.getGroupMask(mask)) { uint32_t msk = mask; for (group = 0; group <= EasyVR::PASSWORD; ++group, msk >>= 1) { if (!(msk & 1)) continue; if (group == EasyVR::TRIGGER) pcSerial.print(F("Trigger: ")); else if (group == EasyVR::PASSWORD) pcSerial.print(F("Password: ")); else { pcSerial.print(F("Group ")); pcSerial.print(group); pcSerial.print(F(" has ")); } count = easyvr.getCommandCount(group); pcSerial.print(count); if (group == 0) pcSerial.println(F(" trigger(s)")); else pcSerial.println(F(" command(s)")); for (int8_t idx = 0; idx < count; ++idx) { if (easyvr.dumpCommand(group, idx, name, train)) { pcSerial.print(idx); pcSerial.print(F(" = ")); pcSerial.print(name); pcSerial.print(F(", Trained ")); pcSerial.print(train, DEC); if (!easyvr.isConflict()) pcSerial.println(F(" times, OK")); else { int8_t confl = easyvr.getWord(); if (confl >= 0) pcSerial.print(F(" times, Similar to Word ")); else { confl = easyvr.getCommand(); pcSerial.print(F(" times, Similar to Command ")); } pcSerial.println(confl); } } } } } group = 0; set = 0; mask |= 1; // force to use trigger (mixed SI/SD) useCommands = (mask != 0); isSleeping = false; pcSerial.println(F("---")); } const char* ws0[] = { "ROBOT", }; const char* ws1[] = { "ACTION", "MOVE", "TURN", "RUN", "LOOK", "ATTACK", "STOP", "HELLO", }; const char* ws2[] = { "LEFT", "RIGHT", "UP", "DOWN", "FORWARD", "BACKWARD", }; const char* ws3[] = { "ZERO", "ONE", "TWO", "THREE", "FOUR", "FIVE", "SIX", "SEVEN", "EIGHT", "NINE", "TEN", }; const char** ws[] = { ws0, ws1, ws2, ws3 }; int readNum() { int rx; int num = 0; delay(5); while ((rx = pcSerial.read()) >= 0) { delay(5); if (isdigit(rx)) num = num * 10 + (rx - '0'); else break; } return num; } bool checkMonitorInput() { if (pcSerial.available() <= 0) return false; // check console commands int16_t rx = pcSerial.read(); if (rx == EasyVR::BRIDGE_ESCAPE_CHAR) { setup(); return true; } if (isSleeping) { // any character received will exit sleep isSleeping = false; easyvr.stop(); pcSerial.println(F("Forced wake-up!")); return true; } if (rx == 'l') { easyvr.stop(); lang++; if (easyvr.setLanguage(lang) || easyvr.setLanguage(lang = 0)) { pcSerial.print(F("Language set to ")); pcSerial.println(lang); } else pcSerial.println(F("Error while setting language!")); } if (rx == 'b') { useTokens = false; useCommands = false; useGrammars = true; set++; if (set > 3) set = 0; } if (rx == 'g' && grammars > 4) { useTokens = false; useCommands = false; useGrammars = true; set++; if (set >= grammars) set = 4; } if (rx == 'c') { useTokens = false; useCommands = true; useGrammars = false; do { group++; if (group > EasyVR::PASSWORD) group = 0; } while (!((mask >> group) & 1)); } if (rx == 'k') { useTokens = true; useCommands = false; useGrammars = false; } if (rx == '4') { bits = 4; } if (rx == '8') { bits = 8; } if (rx == 'n') { int16_t num = readNum(); pcSerial.print(F("Play token ")); pcSerial.println(num); easyvr.stop(); easyvr.sendToken(bits, num); } if (rx == 's') { int16_t num = 0; delay(5); while ((rx = pcSerial.read()) >= 0) { delay(5); if (isdigit(rx)) num = num * 10 + (rx - '0'); else break; } pcSerial.print(F("Play sound ")); pcSerial.println(num); easyvr.stop(); easyvr.playSound(num, EasyVR::VOL_DOUBLE); } if (rx == 'd') { easyvr.stop(); pcSerial.println(F("Play tones:")); int16_t num = 0; delay(5); while ((rx = pcSerial.read()) >= 0) { delay(5); if (isdigit(rx)) num = rx - '0'; else if (rx == '*') num = 10; else if (rx == '#') num = 11; else if (rx >= 'A' && rx <= 'D') num = rx - 'A'; else if (rx == '_') num = -1; else break; pcSerial.print(num); if (easyvr.playPhoneTone(num, 3)) pcSerial.println(F(" OK")); else pcSerial.println(F(" ERR")); } } if (rx == 'm') { int16_t num = readNum(); pcSerial.print(F("Mic distance ")); pcSerial.println(num); easyvr.stop(); easyvr.setMicDistance(num); } if (rx == 'w') { int8_t mode = 0; delay(5); while ((rx = pcSerial.read()) >= 0) { delay(5); if (rx == 'w') mode = EasyVR::WAKE_ON_WHISTLE; if (rx == '2') mode = EasyVR::WAKE_ON_2CLAPS; if (rx == '3') mode = EasyVR::WAKE_ON_3CLAPS; if (rx == 'l') mode = EasyVR::WAKE_ON_LOUDSOUND; } pcSerial.print(F("Sleep mode ")); pcSerial.println(mode); easyvr.stop(); if (easyvr.getID() < EasyVR::EASYVR3) easyvr.setPinOutput(EasyVR::IO1, LOW); // Shield 2.0 LED off isSleeping = easyvr.sleep(mode); return true; } if (rx == 'r') { int8_t num = readNum(); pcSerial.print(F("Record (5 seconds) message ")); pcSerial.println(num); easyvr.stop(); easyvr.recordMessageAsync(num, 8, 5); useTokens = false; useCommands = false; useGrammars = false; isBusy = true; return true; } if (rx == 'p') { int8_t num = readNum(); pcSerial.print(F("Play message ")); pcSerial.println(num); easyvr.stop(); easyvr.playMessageAsync(num, EasyVR::SPEED_NORMAL, EasyVR::ATTEN_NONE); useTokens = false; useCommands = false; useGrammars = false; isBusy = true; return true; } if (rx == 'e') { int8_t num = readNum(); pcSerial.print(F("Erase message ")); pcSerial.println(num); easyvr.stop(); easyvr.eraseMessageAsync(num); useTokens = false; useCommands = false; useGrammars = false; isBusy = true; return true; } if (rx >= 0) { easyvr.stop(); pcSerial.flush(); return true; } return false; } void loop() { checkMonitorInput(); if (!isSleeping && !isBusy) { if (easyvr.getID() < EasyVR::EASYVR3) easyvr.setPinOutput(EasyVR::IO1, HIGH); // Shield 2.0 LED on (listening) if (useTokens) { pcSerial.print(F("Detect a ")); pcSerial.print(bits); pcSerial.println(F(" bit token ...")); easyvr.detectToken(bits, EasyVR::REJECTION_AVG, 0); } else if (useCommands) { pcSerial.print(F("Say a command in Group ")); pcSerial.println(group); easyvr.recognizeCommand(group); } else if (useGrammars) { pcSerial.print(F("Say a word in Wordset ")); pcSerial.println(set); easyvr.recognizeWord(set); } } do { if (checkMonitorInput()) return; } while (!easyvr.hasFinished()); isSleeping = false; isBusy = false; if (easyvr.getID() < EasyVR::EASYVR3) easyvr.setPinOutput(EasyVR::IO1, LOW); // Shield 2.0 LED off if (easyvr.isAwakened()) { pcSerial.println(F("Audio wake-up!")); return; } int16_t idx; if (useTokens) { idx = easyvr.getToken(); if (idx >= 0) { pcSerial.print(F("Token: ")); pcSerial.println(idx); easyvr.playSound(0, EasyVR::VOL_FULL); } } // handle voice recognition idx = easyvr.getWord(); if (idx >= 0) { pcSerial.print(F("Word: ")); pcSerial.print(easyvr.getWord()); pcSerial.print(F(" = ")); if (useCommands) pcSerial.println(ws[group][idx]); // --- optional: builtin words can be retrieved from the module else if (set < 4) pcSerial.println(ws[set][idx]); // --- else { uint8_t flags, num; if (easyvr.dumpGrammar(set, flags, num)) while (idx-- >= 0) { if (!easyvr.getNextWordLabel(name)) break; } if (idx < 0) pcSerial.println(name); else pcSerial.println(); } // ok, let's try another set if (set < 4) { set++; if (set > 3) set = 0; } else { set++; if (set >= grammars) set = 4; } easyvr.playSound(0, EasyVR::VOL_FULL); } else { idx = easyvr.getCommand(); if (idx >= 0) { pcSerial.print(F("Command: ")); pcSerial.print(easyvr.getCommand()); if (easyvr.dumpCommand(group, idx, name, train)) { pcSerial.print(F(" = ")); pcSerial.println(name); } else pcSerial.println(); // ok, let's try another group do { group++; if (group > EasyVR::PASSWORD) group = 0; } while (!((mask >> group) & 1)); easyvr.playSound(0, EasyVR::VOL_FULL); } else // errors or timeout { int16_t err = easyvr.getError(); if (err >= 0) { pcSerial.print(F("Error 0x")); pcSerial.println(err, HEX); } else if (easyvr.isTimeout()) pcSerial.println(F("Timed out.")); else pcSerial.println(F("Done.")); } } }

Price: 89.99 USD

Location: Sunnyvale, California

End Time: 2024-12-15T23:31:42.000Z

Shipping Cost: N/A USD