EchoEar AI Development Kit User Manual

1. ആമുഖം

The EchoEar AI Development Kit is an intelligent AI development platform designed for voice interaction products that require large language model (LLM) capabilities. It is suitable for applications such as smart toys, smart speakers, and smart central control systems.

The device features an ESP32-S3-WROOM-1 module, a 1.85-inch QSPI circular touch screen, and a dual microphone array. It supports offline voice wake-up and sound source localization algorithms. By integrating with large model capabilities from services like OpenAI, Xiaozhi AI, and Gemini, EchoEar enables full-duplex voice interaction, multimodal recognition, and intelligent agent control. This kit provides a robust foundation for developers to create comprehensive edge-side AI application experiences.

പ്രധാന അറിയിപ്പ്:

• This product has different model options regarding color and battery inclusion. Please ensure you select the correct model to match your preferences. It can be powered via USB or be paired with an optional 3.7V polymer lithium battery (model: 902530, 700mAh).
• The motor base is not included in the default kit.
• EchoEar is an AI development board for LLM. The features demonstrated in product videos are achievable implementations based on this board. You can realize these functions yourself using our open-source code, and we will continue to publish related examples on GitHub. Please consider this before purchasing—we welcome you to join us in exploring AI development!

2. ഘടകങ്ങൾ കഴിഞ്ഞുview

The EchoEar AI Development Kit consists of several key components, including the CoreBoard, MicBoard, and BaseBoard, along with various connectors and indicators. Below is a detailed description of the main components and their functions, as well as their layout on the PCBs and housing.

2.1 CoreBoard Components

Image: EchoEar CoreBoard PCB Front View, showing ESP32-S3-WROOM-1, Speaker Connector, Touch Connector, Mic Board Connector, LCD FPC Connector, and Battery Connector.

Image: EchoEar CoreBoard PCB Back View, showing ES8311, NS4150B, BMI270, BaseBoard Connector, SY8088AAC, and ES7210.

2.2 MicBoard Components

Image: EchoEar MicBoard PCB Front View, showing Green LED, MIC, and LCD Screen.

Image: EchoEar MicBoard PCB Back View, showing FPC Connector.

2.3 BaseBoard Components

Image: EchoEar BaseBoard PCB Front View, showing Type-C port, BQ27220, TP4057, CoreBoard Connector, SAM8108, and TLV62569.

Image: EchoEar BaseBoard PCB Back View, showing SD Card slot, BOOT Button, RST Button, M1.6 Welded Nut, Magnetic Connector, and Power Switch.

2.4 ഘടക വിവരണങ്ങൾ

3. സജ്ജീകരണവും പ്രാരംഭ കോൺഫിഗറേഷനും

This section provides guidance on the initial hardware setup and how to flash firmware onto your EchoEar AI Development Kit.

3.1 ഹാർഡ്‌വെയർ അസംബ്ലി

The EchoEar kit typically comes pre-assembled. However, if you are working with individual components or need to reassemble, refer to the "Components Overview" section for the layout of the CoreBoard, MicBoard, and BaseBoard, and their respective connectors.

• Ensure the CoreBoard is securely connected to the BaseBoard via the CoreBoard Connector.
• Connect the MicBoard to the CoreBoard using the FPC Connector.
• If using an optional 3.7V polymer lithium battery (model: 902530, 700mAh), connect it to the Battery Connector on the CoreBoard, ensuring correct polarity (top pin positive, bottom negative).
• Insert a microSD card (up to 32 GB) into the SD Card Slot on the BaseBoard if you plan to store audio, images, or video data.
• The main board is fixed to the housing using M1.6 Welded Nuts.

3.2 Powering On and Firmware Flashing

1. വൈദ്യുതി വിതരണം: Connect the EchoEar to a power source using the USB-C interface. This interface also supports programming download and debugging, and charges lithium batteries.
2. പവർ ഓൺ/ഓഫ്: Use the POWER Switch on the BaseBoard to control the device's power. A single click toggles the power status.
3. ഡൗൺലോഡ് മോഡിൽ പ്രവേശിക്കുന്നു: To flash new firmware, hold down the BOOT Button on the BaseBoard while powering on the device. This will put the device into download mode, allowing you to upload firmware via the USB-C interface.
4. ഫേംവെയർ വികസനം: Refer to the official Espressif documentation and GitHub repositories for open-source code and examples to develop and flash your AI applications.

4. പ്രവർത്തന നിർദ്ദേശങ്ങൾ

The EchoEar AI Development Kit is designed for developers to implement and test AI-powered voice interaction applications. Its operation largely depends on the firmware and applications you develop and deploy.

4.1 അടിസ്ഥാന ഇടപെടൽ

• വോയ്സ് ഉണർവ്: The dual microphone array supports local voice wake-up. Once configured in your firmware, you can activate the device using a predefined wake-word.
• വോയ്സ് കമാൻഡുകൾ: After wake-up, the device can process voice commands. The specific commands and their responses are determined by your implemented LLM and AI agent logic.
• സ്പർശന ഇടപെടൽ: The 1.85-inch circular LCD screen supports touch functionality. Your applications can utilize this for graphical user interface (GUI) interactions.
• ഓഡിയോ ഔട്ട്പുട്ട്: The built-in 3W speaker provides audio feedback and responses from your AI applications.

4.2 Advanced Features (Developer-Dependent)

• Full-Duplex Voice Interaction: With appropriate LLM integration, EchoEar can engage in natural, continuous conversations.
• Multimodal Recognition: Develop applications that combine voice input with other sensor data (e.g., from the BMI270 IMU) for richer interaction.
• Intelligent Agent Control: Utilize the kit to create AI agents capable of controlling external devices or performing complex tasks.
• ഡാറ്റ സംഭരണം: The SD Card Slot allows for storage of application data, logs, audio recordings, or other media.
• Functional Expansion: The Magnetic Connector provides a serial port and 5V power interface for connecting to a rotating base or other external devices, enabling further functional expansion.

5. പരിപാലനവും പരിചരണവും

To ensure the longevity and optimal performance of your EchoEar AI Development Kit, follow these maintenance guidelines:

• വൃത്തിയാക്കൽ: Use a soft, dry cloth to clean the device. Avoid using liquid cleaners or solvents, as they may damage the electronic components or the screen.
• സംഭരണം: നേരിട്ടുള്ള സൂര്യപ്രകാശം, തീവ്രമായ താപനില, ഉയർന്ന ഈർപ്പം എന്നിവയിൽ നിന്ന് മാറി തണുത്തതും വരണ്ടതുമായ സ്ഥലത്ത് ഉപകരണം സൂക്ഷിക്കുക.
• ബാറ്ററി കെയർ: If using a lithium battery, avoid fully discharging it for extended periods. Charge it regularly, even if not in use, to maintain battery health.
• കൈകാര്യം ചെയ്യൽ: ഭൗതികമായ കേടുപാടുകൾ ഒഴിവാക്കാൻ ഉപകരണം ശ്രദ്ധയോടെ കൈകാര്യം ചെയ്യുക. താഴെ വീഴുകയോ ശക്തമായ ആഘാതങ്ങൾക്ക് വിധേയമാക്കുകയോ ചെയ്യരുത്.
• ഫേംവെയർ അപ്‌ഡേറ്റുകൾ: Regularly check the official Espressif GitHub repository for firmware updates and security patches to keep your development environment secure and up-to-date.

6. പ്രശ്‌നപരിഹാരം

This section provides basic troubleshooting steps for common issues you might encounter with your EchoEar AI Development Kit. As a development kit, many issues may stem from software/firmware configuration rather than hardware faults.

6.1 വൈദ്യുതി പ്രശ്നങ്ങൾ

• ഉപകരണം പവർ ഓൺ ചെയ്യുന്നില്ല:
  • Ensure the USB-C cable is securely connected to a working power source and the device.
  • If using a battery, check if it is charged. The TP4057 chip manages battery charging.
  • Verify the POWER Switch is in the 'on' position.
  • Inspect the Battery Connector for proper connection and polarity if a battery is installed.

6.2 Firmware and Connectivity Issues

• Unable to flash firmware:
  • Ensure the device is in download mode by holding the BOOT Button while powering on.
  • Check your USB-C connection and drivers on your development machine.
  • Verify your flashing tool and firmware image are correct and compatible.
• Wi-Fi/Bluetooth connectivity problems:
  • Confirm your firmware includes the necessary Wi-Fi/Bluetooth drivers and configuration for the ESP32-S3-WROOM-1 module.
  • Check for interference from other 2.4 GHz devices.
  • Ensure your network credentials are correctly configured in your application.

6.3 Audio and Display Issues

• സ്പീക്കറിൽ നിന്ന് ശബ്ദമില്ല:
  • Check the Speaker Connector for a secure connection.
  • Verify that your firmware is correctly utilizing the NS4150B amplifier and ES8311 audio codec.
  • Ensure the volume is not set to zero in your application.
• Microphones not responding:
  • Check the MicBoard Connector for a secure connection.
  • Confirm your firmware is correctly configured to use the LMA3729T381-OY3S microphone array.
• Display not working or unresponsive touch:
  • Check the LCD FPC Connector and Touch Connector for secure connections.
  • Verify your firmware's display and touch drivers are correctly initialized for the 1.85-inch QSPI circular touch screen.

For more in-depth troubleshooting and development support, please refer to the official Espressif documentation, community forums, and GitHub repositories.

7 സ്പെസിഫിക്കേഷനുകൾ

8 ഉപയോക്തൃ നുറുങ്ങുകൾ

ഒരു പ്രത്യേക ഉപയോക്താവും ഇല്ലെങ്കിലുംviews or Q&A were provided, here are some general tips for working with the EchoEar AI Development Kit:

• Start with Exampകുറവ്: Begin by exploring the official open-source code and examples provided by Espressif on GitHub. This will help you understand the basic functionalities and development workflow.
• കമ്മ്യൂണിറ്റി പിന്തുണ: Engage with the Espressif developer community. Forums and online groups can be valuable resources for troubleshooting and sharing ideas.
• ഊർജ്ജനിയന്ത്രണം: If using a battery, monitor its charge level, especially during intensive development or testing, to avoid unexpected shutdowns.
• ഡോക്യുമെൻ്റേഷൻ: Always refer to the latest official documentation for the ESP32-S3 and related components for detailed technical information.
• Experiment Safely: When connecting external components via the Magnetic Connector or other interfaces, ensure proper wiring and power supply to prevent damage to the kit or peripherals.

9. വാറൻ്റിയും പിന്തുണയും

For warranty information, technical support, and further resources, please refer to the official Espressif Systems website and their dedicated support channels. As a development kit, support primarily focuses on hardware functionality and providing resources for software development.

ഉദ്യോഗസ്ഥൻ Webസൈറ്റ്: espressif.com

GitHub Repository: Check Espressif's official GitHub for open-source code, examples, and documentation related to the EchoEar AI Development Kit.