您尚未登录。

#1 Re: ESP32/ESP8266 » 用过esp-adf/example/speech_recognition/asr例子的帮忙看一下 » 2020-05-18 07:53:20

这个问题解决了么?我也遇到这个问题了,看资料说貌似是因为唤醒是wakenet引擎,关键词用的是multinet引擎,代码里貌似只有唤醒引擎能工作,需要改成multinet也能工作

#2 Re: ESP32/ESP8266 » ESP32-LyraT DuerOS例程运行语音没反应 » 2020-05-15 23:29:22

问题解决了,根据官方论坛上一个叫“超喜欢嵌入式的70后老猿人”帮助,发现下面的错误、:
AUDIO_THREAD: Not found right xTaskCreateRestrictedPinnedToCore. Please apply the $ADF_PATH/idf_patches/idf_v3.3_freertos.patch first
AUDIO_THREAD: Error creating RestrictedPinnedToCore filter
AUDIO_ELEMENT: [filter] audio_thread_create failed
这是因为目前的ADFv2.0和自带的IDFv3.3.2-107-g722043f73不匹配,FreeRTOS的task.c有缺失。
替换掉此路径下的task.h:\ components \ freertos \ include \ freertos   
和此路径下的task.c  :\ components \ freertos
注意替换的是IDFv3.3.2内的组件目录
https://pan.baidu.com/s/12MUUFKmUwx9sUrEwnG4ljQ/
提取码:gqo3

#3 ESP32/ESP8266 » ESP32-LyraT DuerOS例程运行语音没反应 » 2020-05-15 09:32:08

xjp13
回复: 3

按照官方文档编译了duerOS例程,烧到ESP32-LyraT 板子上,重启后从打印信息看貌似一切正常,且duerOS平台上能看到设备在线,按键和触摸都能看到输入信号,就是语音没有任何反应,不管是语音唤醒还是按键唤醒,打印结果如下:

ets Jun  8 2016 00:22:57

rst:0x1 (POWERON_RESET),boot:0x3f (SPI_FAST_FLASH_BOOT)
flash read err, 1000
ets_main.c 371 
ets Jun  8 2016 00:22:57

rst:0x10 (RTCWDT_RTC_RESET),boot:0x3f (SPI_FAST_FLASH_BOOT)
configsip: 0, SPIWP:0xee
clk_drv:0x00,q_drv:0x00,d_drv:0x00,cs0_drv:0x00,hd_drv:0x00,wp_drv:0x00
mode:DIO, clock div:1
load:0x3fff0018,len:4
load:0x3fff001c,len:6760
load:0x40078000,len:11116
load:0x40080400,len:6004
entry 0x40080704
[0;32mI (61) boot: Chip Revision: 1[0m
[0;32mI (63) boot_comm: chip revision: 1, min. bootloader chip revision: 0[0m
[0;32mI (39) boot: ESP-IDF v3.3.2-107-g722043f73 2nd stage bootloader[0m
[0;32mI (39) boot: compile time 23:49:46[0m
[0;32mI (67) boot: Enabling RNG early entropy source...[0m
[0;32mI (67) boot: SPI Speed      : 80MHz[0m
[0;32mI (67) boot: SPI Mode       : DIO[0m
[0;32mI (69) boot: SPI Flash Size : 4MB[0m
[0;32mI (73) boot: Partition Table:[0m
[0;32mI (77) boot: ## Label            Usage          Type ST Offset   Length[0m
[0;32mI (84) boot:  0 nvs              WiFi data        01 02 00009000 00006000[0m
[0;32mI (92) boot:  1 phy_init         RF data          01 01 0000f000 00001000[0m
[0;32mI (99) boot:  2 factory          factory app      00 00 00010000 00200000[0m
[0;32mI (107) boot: End of partition table[0m
[0;32mI (111) boot_comm: chip revision: 1, min. application chip revision: 0[0m
[0;32mI (118) esp_image: segment 0: paddr=0x00010020 vaddr=0x3f400020 size=0x82ed4 (536276) map[0m
[0;32mI (276) esp_image: segment 1: paddr=0x00092efc vaddr=0x3ffb0000 size=0x0425c ( 16988) load[0m
[0;32mI (282) esp_image: segment 2: paddr=0x00097160 vaddr=0x40080000 size=0x00400 (  1024) load[0m
[0;32mI (283) esp_image: segment 3: paddr=0x00097568 vaddr=0x40080400 size=0x08aa8 ( 35496) load[0m
[0;32mI (304) esp_image: segment 4: paddr=0x000a0018 vaddr=0x400d0018 size=0x132890 (1255568) map[0m
[0;32mI (653) esp_image: segment 5: paddr=0x001d28b0 vaddr=0x40088ea8 size=0x130cc ( 78028) load[0m
[0;32mI (696) boot: Loaded app from partition at offset 0x10000[0m
[0;32mI (697) boot: Disabling RNG early entropy source...[0m
[0;32mI (697) psram: This chip is ESP32-D0WD[0m
[0;32mI (702) spiram: Found 32MBit SPI RAM device[0m
[0;32mI (706) spiram: SPI RAM mode: flash 80m sram 40m[0m
[0;32mI (711) spiram: PSRAM initialized, cache is in low/high (2-core) mode.[0m
[0;32mI (719) cpu_start: Pro cpu up.[0m
[0;32mI (722) cpu_start: Application information:[0m
[0;32mI (727) cpu_start: Project name:     esp_dueros[0m
[0;32mI (732) cpu_start: App version:      v2.0-54-gabaaa79-dirty[0m
[0;32mI (739) cpu_start: Compile time:     May 14 2020 23:50:31[0m
[0;32mI (745) cpu_start: ELF file SHA256:  1c1ec4d95617f737...[0m
[0;32mI (751) cpu_start: ESP-IDF:          v3.3.2-107-g722043f73[0m
[0;32mI (757) cpu_start: Starting app cpu, entry point is 0x40081590[0m
[0;32mI (0) cpu_start: App cpu up.[0m
[0;32mI (1642) spiram: SPI SRAM memory test OK[0m
[0;32mI (1642) heap_init: Initializing. RAM available for dynamic allocation:[0m
[0;32mI (1642) heap_init: At 3FFAE6E0 len 00001920 (6 KiB): DRAM[0m
[0;32mI (1649) heap_init: At 3FFBB958 len 000246A8 (145 KiB): DRAM[0m
[0;32mI (1655) heap_init: At 3FFE0440 len 00003AE0 (14 KiB): D/IRAM[0m
[0;32mI (1661) heap_init: At 3FFE4350 len 0001BCB0 (111 KiB): D/IRAM[0m
[0;32mI (1668) heap_init: At 4009BF74 len 0000408C (16 KiB): IRAM[0m
[0;32mI (1674) cpu_start: Pro cpu start user code[0m
[0;32mI (1679) spiram: Adding pool of 4096K of external SPI memory to heap allocator[0m
[0;32mI (134) cpu_start: Starting scheduler on PRO CPU.[0m
[0;32mI (0) cpu_start: Starting scheduler on APP CPU.[0m
[0;32mI (134) spiram: Reserving pool of 32K of internal memory for DMA/internal allocations[0m
[0;32mI (174) DUEROS: ADF version is v2.0-54-gabaaa79-dirty[0m
[0;32mI (175) gpio: GPIO[36]| InputEn: 1| OutputEn: 0| OpenDrain: 0| Pullup: 1| Pulldown: 0| Intr:3 [0m
[0;32mI (179) gpio: GPIO[39]| InputEn: 1| OutputEn: 0| OpenDrain: 0| Pullup: 1| Pulldown: 0| Intr:3 [0m
[0;33mW (215) PERIPH_TOUCH: _touch_init[0m
[0;32mI (215) SDCARD: Trying to mount with base path=/sdcard[0m
[0;32mI (303) SDCARD: CID name SU04G!
[0m
[0;32mI (688) gpio: GPIO[19]| InputEn: 1| OutputEn: 0| OpenDrain: 0| Pullup: 1| Pulldown: 0| Intr:3 [0m
[0;31mE (689) gpio: gpio_install_isr_service(412): GPIO isr service already installed[0m
[0;32mI (722) gpio: GPIO[21]| InputEn: 0| OutputEn: 1| OpenDrain: 0| Pullup: 0| Pulldown: 0| Intr:0 [0m
[0;32mI (722) ES8388_DRIVER: init,out:02, in:00[0m
[0;32mI (731) ESP_AUDIO_TASK: media_ctrl_task running...,0x3f806bac[0m


----------------------------- ESP Audio Platform -----------------------------
|                                                                            |
|                      ESP_AUDIO-v1.5.6-16-gcf04695-dirty                    |
|                     Compile date: May  9 2020-14:49:56                     |
------------------------------------------------------------------------------

[0;32mI (772) ESP_AUDIO_CTRL: Func:media_ctrl_create, Line:274, MEM Total:4377324 Bytes, Inter:260192 Bytes, Dram:243704 Bytes

[0m
[0;32mI (783) AUDIO_HAL: Codec mode is 3, Ctrl:1[0m
[0;32mI (793) STAGEFRIGHTMP3_DECODER: MP3 init[0m
[0;32mI (794) I2S: DMA Malloc info, datalen=blocksize=1200, dma_buf_count=3[0m
[0;32mI (812) I2S: DMA Malloc info, datalen=blocksize=1200, dma_buf_count=3[0m
[0;32mI (814) I2S: APLL: Req RATE: 48000, real rate: 47999.961, BITS: 16, CLKM: 1, BCK_M: 8, MCLK: 12287990.000, SCLK: 1535998.750000, diva: 1, divb: 0[0m
[0;32mI (826) LYRAT_V4_3: I2S0, MCLK output by GPIO0[0m
[0;32mI (833) AUDIO_WRAPPER: Func:setup_player, Line:161, MEM Total:4364476 Bytes, Inter:243668 Bytes, Dram:227180 Bytes

[0m
[0;32mI (858) AUDIO_WRAPPER: esp_audio instance is:0x3f806bac[0m
I (911) wifi:wifi driver task: 3ffd34dc, prio:23, stack:3584, core=0
[0;32mI (911) system_api: Base MAC address is not set, read default base MAC address from BLK0 of EFUSE[0m
[0;32mI (915) system_api: Base MAC address is not set, read default base MAC address from BLK0 of EFUSE[0m
I (942) wifi:wifi firmware version: 5f8804c
I (942) wifi:config NVS flash: enabled
I (943) wifi:config nano formating: disabled
I (943) wifi:Init dynamic tx buffer num: 32
I (947) wifi:Init data frame dynamic rx buffer num: 32
I (951) wifi:Init management frame dynamic rx buffer num: 32
I (957) wifi:Init management short buffer num: 32
I (961) wifi:Init static tx buffer num: 16
I (966) wifi:Init static rx buffer size: 1600
I (969) wifi:Init static rx buffer num: 16
I (973) wifi:Init dynamic rx buffer num: 32
[0;32mI (1063) phy: phy_version: 4180, cb3948e, Sep 12 2019, 16:39:13, 0, 0[0m
I (1064) wifi:mode : sta (24:0a:c4:9d:03:f8)
I (1187) wifi:new:<1,1>, old:<1,0>, ap:<255,255>, sta:<1,1>, prof:1
I (1188) wifi:state: init -> auth (b0)
I (1190) wifi:state: auth -> assoc (0)
I (1195) wifi:state: assoc -> run (10)
I (1203) wifi:connected with TP-LINK_00B0, aid = 4, channel 1, 40U, bssid = fc:d7:33:b9:00:b0
I (1203) wifi:security type: 4, phy: bgn, rssi: -18
I (1213) wifi:pm start, type: 1

I (1214) wifi:AP's beacon interval = 102400 us, DTIM period = 1
I (1725,tid:3ffc4628) lightduer_session.c(  44):random = 75933
[0;32mI (1932) WIFI_SERV: Connect to wifi ssid: TP-LINK_00B0, pwd: 123456789[0m
[0;33mW (1935) I2S: I2S driver already installed[0m
[0;32mI (1935) LYRAT_V4_3: I2S0, MCLK output by GPIO0[0m
[0;32mI (1939) AUDIO_PIPELINE: link el->rb, el:0x3f808c98, tag:i2s, rb:0x3f808fd4[0m
[0;32mI (1946) AUDIO_PIPELINE: link el->rb, el:0x3f808dc4, tag:filter, rb:0x3f809010[0m
[0;32mI (1954) AUDIO_ELEMENT: [i2s] Element task created[0m
[0;32mI (1959) AUDIO_THREAD: The filter task allocate stack on external memory[0m
[0;31mE (1967) AUDIO_THREAD: Not found right xTaskCreateRestrictedPinnedToCore. Please apply the $ADF_PATH/idf_patches/idf_v3.3_freertos.patch first[0m
[0;31mE (1980) AUDIO_THREAD: Error creating RestrictedPinnedToCore filter[0m
[0;31mE (1987) AUDIO_ELEMENT: [filter] audio_thread_create failed[0m
[0;32mI (1993) AUDIO_ELEMENT: [raw] Element task created[0m
[0;32mI (1998) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:358, MEM Total:4270892 Bytes, Inter:149504 Bytes, Dram:133016 Bytes

[0m
[0;33mW (2010) AUDIO_ELEMENT: [filter] Element has not create when AUDIO_ELEMENT_RESUME[0m
[0;32mI (2010) AUDIO_ELEMENT: [i2s] AEL_MSG_CMD_RESUME,state:1[0m
[0;31mE (2019) AUDIO_PIPELINE: audio_pipeline_resume failed[0m
[0;32mI (2025) I2S_STREAM: AUDIO_STREAM_READER,Rate:48000,ch:2[0m
[0;33mW (2030) AUDIO_PIPELINE: Without stop, st:6[0m
[0;32mI (2038) I2S: APLL: Req RATE: 48000, real rate: 47999.961, BITS: 16, CLKM: 1, BCK_M: 8, MCLK: 12287990.000, SCLK: 1535998.750000, diva: 1, divb: 0[0m
[0;33mW (2041) AUDIO_PIPELINE: Without wait stop, st:6[0m
[0;32mI (2068) AUDIO_ELEMENT: [i2s] Element task destroyed[0m
[0;33mW (2068) AUDIO_ELEMENT: [filter] Element has not create when AUDIO_ELEMENT_TERMINATE[0m
[0;32mI (2074) DUEROS: Recorder has been created[0m
Quantized wakeNet5: wakeNet5_v1_nihaoxiaozhi_6_0.983_0.95, mode:0 (Nov 20 2019 14:34:43)
[0;32mI (2087) REC_ENG: ESP SR Engine, chunksize is 480锛? FRAME_SIZE:960, frequency:16000[0m
[0;31mE (2095) REC_ENG: Recorder Engine Running ..., vad_window=9, wakeup=10000 ms, vad_off=800 ms, threshold=90 ms, sensitivity=0[0m
[0;32mI (2107) REC_ENG: state idle[0m
[0;32mI (2191) event: sta ip: 192.168.0.103, mask: 255.255.255.0, gw: 192.168.0.1[0m
[0;32mI (2192) WIFI_SERV: Got ip:192.168.0.103[0m
[0;33mW (2193) WIFI_SERV: STATE type:2, pdata:0x0, len:0[0m
[0;32mI (2215) DUEROS: PERIPH_WIFI_CONNECTED [213][0m
[0;31mE (2215) DUEROS: Recv Que DUER_CMD_LOGIN[0m
[0;32mI (2216) DUEROS: duer_start, len:1470
{"configures":"{}","bindToken":"d355efa997ebf4d24149eafdddef3577","coapPort":443,"token":"PQS5sVPRhX6iCP4XkYUkMbx8UJjuULdj","serverAddr":"device.iot.baidu.com","lwm2mPort":443,"uuid":"2055000000000a","rsaCaCrt":"-----BEGIN CERTIFICATE-----\nMIIDUDCCAjgCCQCmVPUErMYmCjANBgkqhkiG9w0BAQUFADBqMQswCQYDVQQGEwJD\nTjETMBEGA1UECAwKU29tZS1TdGF0ZTEOMAwGA1UECgwFYmFpZHUxGDAWBgNVBAMM\nDyouaW90LmJhaWR1LmNvbTEcMBoGCSqGSIb3DQEJARYNaW90QGJhaWR1LmNvbTAe\nFw0xNjAzMTEwMzMwNDlaFw0yNjAzMDkwMzMwNDlaMGoxCzAJBgNVBAYTAkNOMRMw\nEQYDVQQIDApTb21lLVN0YXRlMQ4wDAYDVQQKDAViYWlkdTEYMBYGA1UEAwwPKi5p\nb3QuYmFpZHUuY29tMRwwGgYJKoZIhvcNAQkBFg1pb3RAYmFpZHUuY29tMIIBIjAN\nBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAtbhIeiN7pznzuMwsLKQj2xB02+51\nOvCJ5d116ZFLjecp9qtllqOfN7bm+AJa5N2aAHJtsetcTHMitY4dtGmOpw4dlGqx\nluoz50kWJWQjVR+z6DLPnGE4uELOS8vbKHUoYPPQTT80eNVnl9S9h/l7DcjEAJYC\nIYJbf6+K9x+Ti9VRChvWcvgZQHMRym9j1g/7CKGMCIwkC+6ihkGD/XG40r7KRCyH\nbD53KnBjBO9FH4IL3rGlZWKWzMw3zC6RTS2ekfEsgAtYDvROKd4rNs+uDU9xaBLO\ndXTl5uxgudH2VnVzWtj09OUbBtXcQFD2IhmOl20BrckYul+HEIMR0oDibwIDAQAB\nMA0GCSqGSIb3DQEBBQUAA4IBAQCzTTH91jNh/uYBEFekSVNg1h1kPSujlwEDDf/W\npjqPJPqrZvW0w0cmYsYibNDy985JB87MJMfJVESG/v0Y/YbvcnRoi5gAenWXQNL4\nh2hf08A5wEQfLO/EaD1GTH3OIierKYZ6GItGrz4uFKHV5fTMiflABCdu37ALGjrA\nrIjwjxQG6WwLr9468hkKrWNG3dMBHKvmqO8x42sZOFRJMkqBbKzaBd1uW4xY5XwM\nS1QX56tVrgO0A3S+4dEg5uiLVN4YVP/Vqh4SMtYkL7ZZiZAxD9GtNnhRyFsWlC2r\nOVSdXs1ttZxEaEBGUl7tgsBte556BIvufZX+BXGyycVJdBu3\n-----END CERTIFICATE-----\n","macId":"","version":15145}[0m
I (2212,tid:3ffc4628) lightduer_engine.c( 220):duer_engine_start, g_handler:3F808AF4, length:1470, profile:3F80D3D0
[0;33mW (2347) DUEROS: duer_callback: type:0, source:0x3f807b64 data:2, data_len:0[0m
I (2226,tid:3ffc4628) lightduer_ca_conf.c(  38):    duer_conf_get_string: uuid = 2055000000000a
I (2238,tid:3ffc4628) lightduer_ca_conf.c(  38):    duer_conf_get_string: serverAddr = device.iot.baidu.com
I (2272,tid:3ffc4628) baidu_ca_socket_adp.c( 134):DNS lookup succeeded. IP=220.181.107.198
I (2325,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
W (2325,tid:3ffc4628) lightduer_events.c(  80):[lightduer_ca] <== event end = 400FB394, timespent = 113
I (3122,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
W (3122,tid:3ffc4628) lightduer_events.c(  80):[lightduer_ca] <== event end = 400FB528, timespent = 744
I (3129,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (3137,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (3146,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (3154,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (3163,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (3171,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (3179,tid:3ffc4628) lightduer_engine.c( 220):duer_engine_start, g_handler:3F808AF4, length:0, profile:00000000
I (3189,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
W (3236,tid:3ffc4628) lightduer_coap.c( 532):duer_coap_nsdl_tx: sent = 0
I (3238,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (3243,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (3249,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (3258,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (3266,tid:3ffc4628) lightduer_connagent.c( 198):will start latter(DUER_ERR_TRANS_WOULD_BLOCK)
I (4067,tid:3ffc4628) lightduer_connagent.c( 177):connect started!
I (4068,tid:3ffc4628) lightduer_voice.c( 697):Mutex initializing
I (4069,tid:3ffc4628) lightduer_ds_log_cache.c(  67):no cache report
[0;31mE (4208) DUEROS: event: 0[0m
[0;32mI (4211) DUEROS: duer_dcs_init[0m
I (4082,tid:3ffc4628) lightduer_dcs_router.c( 283):namespace: ai.dueros.private.protocol
I (4088,tid:3ffc4628) lightduer_dcs_router.c( 283):namespace: ai.dueros.device_interface.screen_extended_card
I (4099,tid:3ffc4628) lightduer_dcs_router.c( 283):namespace: ai.dueros.device_interface.system
I (4107,tid:3ffc4628) lightduer_dcs_router.c( 283):namespace: ai.dueros.device_interface.voice_input
I (4115,tid:3ffc4628) lightduer_dcs_router.c( 283):namespace: ai.dueros.device_interface.voice_output
I (4124,tid:3ffc4628) lightduer_dcs_router.c( 283):namespace: ai.dueros.device_interface.speaker_controller
I (4134,tid:3ffc4628) lightduer_dcs_router.c( 283):namespace: ai.dueros.device_interface.audio_player
[0;32mI (4277) AUDIO_WRAPPER: duer_dcs_get_speaker_state[0m
[0;31mE (4287) DUEROS: event: DUER_EVENT_STARTED[0m
W (4153,tid:3ffc4628) lightduer_events.c(  80):[lightduer_ca] <== event end = 400FB528, timespent = 90
[0;32mI (4288) DUEROS: Dueros DUER_CMD_CONNECTED, duer_state:2[0m
I (4163,tid:3ffc4628) lightduer_connagent.c( 212):add resource successfully!!
[0;33mW (4304) DUEROS: duer_callback: type:0, source:0x3f807b64 data:3, data_len:0[0m
I (4177,tid:3ffc4628) lightduer_connagent.c( 212):add resource successfully!!
W (4189,tid:3ffc4628) lightduer_engine.c( 634):data cache has not sent, pending..., dcache_len:1, qcache_len:4
W (4201,tid:3ffc4628) lightduer_system_info.c( 306):Undefined memory type, 0
E (4207,tid:3ffc4628) lightduer_system_info.c( 389):Sys Info: Get disk info failed

看了论坛里各位的配置,都是按照相应配置弄的,怎么会语音没反应,试了另外几个语音的例程也不行,播放MP3例程倒是没问题。
请教下开发者朋友是否遇到过这个状况?

页脚

工信部备案:粤ICP备20025096号 Powered by FluxBB

感谢为中文互联网持续输出优质内容的各位老铁们。 QQ: 516333132, 微信(wechat): whycan_cn (哇酷网/挖坑网/填坑网) service@whycan.cn