Speech Based Ubiquitous Embedded Text Logger

71

Speech-Based Ubiquitous Embedded Text Logger

1

Assistant Prof. Ch.Karuna Pravaha,

B. Pavani ,

Ch.Gayathri,

A.Sunitha,

Ch.Priyanka

Tirumala Engineering College, Jonnalagadda, Narasaraopet, Andhra Pradesh (Approved by AICTE, New Delhi & Affiliated to JNTUK, Kakinada) Email: [email protected], [email protected]

Abstract:This paper explains about hardware and software development for cost-effective embedded Ubiquitous system. This used to speech recognition for the people who have no hands, either through congenital challenged or amputation and cannot move their limbs but can speak and listen. With the help of this system, differently-abled people will be able to type the text with their speech. They will be able to speak with the people who cannot listen but can read for their help by displaying words on the TFT LCD. In today technologies speech recognition module is used. In this paper, an android mobile application is used to recognize spoken words with the help of google assistance. The device acquires speech at run time through an android mobile application and processes the sampled speech to recognize with the help of google. Android mobile application recognizes the spoken words and converts the voice signal to text output. The converted text is transferred to the ubiquitous embedded device through the Bluetooth module and the received text can be stored in SD card that is connected to an Atmega328P-PU microcontroller.

Keywords—Bluetooth Wireless network, Automatic Voice Recognition, Google voice Assistance, ATMEGA328P-PU.

1. INTRODUCTION

Electronics system design and manufacturing ESDM Technology is developing very fast, and it is helping to improve human being daily lifestyle. This Technology is also helpful for physically challenged persons. Presently more than 20% of people of the world are suffering from various disabilities and Electronic manufacturing Technology is giving support to make their life betterment. ESDM Technology has many real-time applications in different areas like space, communication, transportation, robotic systems, home appliances, etc. and provides potential benefits. Speech recognition and processing reduces the difficulties and solved many problems caused by other communication methods. In the past electronics and computers fields human being voice has not been used much in ESDM Technology. However, with modern improvements in the technology and processes, algorithms, and methods we can process speech recognition easily and use it in electronics fields. Google voice and convert the input speech into text, and transfer the converted text to the ubiquitous embedded devise using wireless Bluetooth communication. The received text is stored in the SD card at the ubiquitous embedded device in .txt file format.

2. PURPOSE

The purpose of this paper is to provide simpler and cost-effective ubiquitous embedded device hardware architecture. With powerful computational platforms so that electronic system designer can focus on their research and tests instead of speech recognition hardware modules. This simple architecture is also useful for educational electronics. Students can build their electronic applications, robotics with low cost and use them a platform for developing and improvements of a human being the daily lifestyle for the betterment.

3. COMPONENTS USED

A. ATMEGA328P-PU

The ATMEGA328P-PU is a low-power; low-cost CMOS 8-bit microcontroller based on the technology AVR enhanced RISC architecture. It can complete the execution of powerful instructions per clock cycle; with its throughputs, 1MIPS for MHz helps developers to reduce the power consumptions in different clock speeds.

The AVR processer core combines a large instruction set with 32 general purpose working registers. All the registers are directly connected to the Arithmetic Logic Unit (ALU), allowing two independent registers to be accessed in one single instruction executed in one cycle. The resulting architecture is more code efficient while achieving throughputs up to ten times faster than conventional CISC microcontrollers.

72 Assemblers, and Program Debugger/Simulators, In-Circuit Emulators, and Evaluation kits.

Figure 1: ATMEGA328P-PU

B. TFT LCD plus Micro SD Card

This is 3.5‖ TFT LCD touch screen display module used to display the received data at

the embedded deviceand then store it in the microSD card in .txt format.

Figure 2: 3.5’’ TFT LCD plus microSD Card (Front and back)

Features: Of 3.5 Inch TFT Touch Plus LCD

 Single chip driver for 262,144-color TFT 320 RGB x 480-dot graphics (it has internal regulated power supply circuits)  Very high resolutions.

 262,144-color display.

 Low-power consumption architecture (allowing direct input of interface I/O power supply)

 Deep standby mode.  8-color mode (Idle Mode).

 TFT LCD storage capacitance: Cst (common VCOM method).

 Internal frame memory: 345,600 bytes.  It has PCB backplane with power IC, SD

card socket and reset button.  16-bit Parallel bus interface.  4-wire resistive touch screen.

C. HC-05 Bluetooth Module

73 Features: Of HC-05 Bluetooth Module

 Bluetooth Protocol V2.0  Range – 10 meters  Frequency – 2.4GHz ISM  Modulation – GFSK  Transmit power – 4dBm  Sensitivity – 8dBm  Power supply - +3.3V  Rate – 2.1Mbps (Max.)

Figure 3: HC-05 Bluetooth Module

D. UART

Universal Asynchronous Receiver Transmitter interface is one of the most used interfaces in Bluetooth communication. UART peripheral is now commonly included on board in

every microcontroller. In some microcontrollers are manufactured with multiple UARTS. Many modern ICs come with a UART that can also communicate synchronously. These devices are called UART.

Figure 4: UART Hardware Connection

E. SPI

Serial peripheral interface (SPI) is one of the most widely used interfaces between the microcontroller and peripheral ICs such as microSD Cards, ADCs, DACs, shift registers, SRAM, and others. SPI is asynchronous, full

duplex master-slave-based interface. The data is exchanged between the master and the slave is synchronized on the rising or falling clock edge. SPI is full duplex communication so that master and slave can exchange the data at a time. The SPI interface hardware requires four wire connections

74 Four-wire SPI devices connection wires:

 Clock (SPI CLK, SCLK) Interface supports much higher clock frequencies compared to I2C interfaces. The developer should check the datasheet for configuring the SPI clock rate. SPI interfaces support one master and multiple slave Architecture. The slave select (SS) signal from the master is used to select the slave. SS pin is normally an active low signal and is pulled high to disconnect the slave from the SPI bus. In multiple

slaves’ connection, an individual slave select signal for each slave is required from the master. MOSI and MISO are the data exchange lines. MOSI send data from the master to the slave and MISO send data from the slave to the master.

4. SYSTEM OVERVIEW

The speech-based Ubiquitous Embedded Text Logger system is an integrated system. It facilitates the elderly and physically challenged people with an easily operated text typing system that operates fully on voice signals. The functional block diagram of this system is shown:

Figure 6: Block Diagram of whole system

The speech input is given to the Android Arduino voice controller application where the speech signal is converted to text signals with the help of Google voice assistance. Upon successful recognition of speech signals at the Android mobile transmit the converted text to the HC-05 Bluetooth module using mobile Bluetooth hardware. At the

Ubiquitous Embedded device, HC-05 received the data and send to the ATMEGA328P-PU microcontroller. The Ubiquitous Embedded device displays the received text data on TFT LCD, and stores it in .txt file format.

75 Figure 7: Power supply circuit

Figure 8: ATMEGA328P-PU controller pin connections

Figure 10: HC-05 Bluetooth Module pin connections

76 Figure 11: Home page in Arduino voice controller Android Application

6. APPLICATION INSTRUCTIONS

 Powering Ubiquitous Embedded device and the TFT LCD will display as shown:

Figure 12: Power on display

 Download Arduino Voice control App in Android App from the google play store link

https://play.google.com/store/apps/details? id=appinventor.ai_cempehlivan92.Arduin o_Sesli_Kontrol

 Install and Open the Arduino Voice control App in Android mobile

 Connect to the HC-05 module from the connect option in App and make sure your HC-05 Bluetooth is paired with your mobile. The default password is "1234" or "0000". Check the manual of Bluetooth module

77 Figure 13: Received data on TFT LCD

 Microcontroller ATMEGA328P-PU store the received data in microSD Card in the text file format as shown:

Figure 14: Stored .txt file in micro SD

78 7. CONCLUTION

This paper aims to realize smart living, more especially for the physically challenged people. Writing text and expressing their needs using display and stored microSD card using system using the Bluetooth and android technology. Ubiquitous embedded devices and smart phones are a perfect match. An Android phones and mobile devices are each time powerful. Using these electronics and Smartphone speech recognition combination can design advanced features, such as home automation, Wireless typing. This can be used in the classroom notes typing, journalism. Android Bluetooth enables mobile phones and Bluetooth module via HC-05 and communication among Bluetooth devices. It is concluded that smart living will gradually turn into reality that for physically challenged people.

8. FUTURE WORK

The knowledge is ever expanding day to day so the problems which human strive to solve. In this paper, we design low cost and user -friendly solution for the physically challenged people. This system can also be implemented as a singular unit in our day to day life for luxurious purposes. Can also be implemented to improve pronunciation and implement it in educational institutes. It is hoped that the current system will lead to further enhancements. For example, work on the future for more accuracy and fast response of Android application.

REFERENCES

[1]Digital notice board using Smart Phones-Speech Recognition Voice command. 2018 International Conference on Current Trends towards Converging Technologies (ICCTCT), IEEE Xplore.

[2]Intelligent Hands Free Speech based SMS System on Android. International Conference on Advances in Human Machine Interaction (HMI – 2016).

[3]Speech to Text Conversion in Real-timeInternational Journal of Innovation and Scientific Research Copyright © 2015 ISSR Journals.

[4] Android Developers Guide. Android Architecture. [online] 2013.

[5] Heidi Monson (1999) Bluetooth technology and implementations, John Wiley & Sons.

[6] Automated Food Ordering System with Real-Time Customer Feedback This project is proposed with wifi technology using Android mobile,laptop and broadband modem and wireless medium [7] Research article on ―Improve performance of work of restaurent using PC touch screen‖ The project is proposed with the wifi technology as the

communication medium, touch screen,software center and wifi base station.

[8] Potts, J. and Sukittanon, S. (2012) ―Exploring Bluetooth on android mobile mobile devices for home security application‖, proceedings of southeast can, 15-18 March 2012, Orlando, Florida,

USA. [9] Piyare, R. and Tazil, M. (2011) ―Bluetooth

based home automation system using Android phones‖.

[10] 3EMenu Card systems for Restaurants by International Journal of Innovative Research in Advanced Engineering The project is proposed with RS-232 cable as the communication medium ,

Peripheral Interface Controller(PIC),computers. [11]HC-05 Bluetooth module, http://www.

Lanwind.com/files/hc-05 en,pdf.