Learning App for Deaf And Mute and sign language-English/Gujarati converter

      

ABSTARCT :

Background: “Inclusivity” is the motto of Education department, Government of Gujarat. Opportunity for all is the new slogan and The Indian Government has come up with Indian Sign Language. There has been lot of work in done in American sign language and focusing on interpretation in English. Majority schools in India adopt local language. In Gujarat, the deaf and mute students would be learning Gujarati by sign language. There are two general methods of deaf education are manualism and oralism..The students learn at school but at home if they want to practice material in Digital form is in limited form especially considering Indian Sign Language and Gujarati as local language. Detailed Description: The proposed comprehensive Mobile Application aims to address the key challenges faced in learning beyond classroom by deaf and mute students. The key features of the application include: Interpretation of Alphabets and numbers in Gujarati: Explaining the alphabets and numbers in Gujarati. The students first should learn and then should get writing pad to practice the writing of alphabets and numbers. Words and Sentences: Explaining the basic words starting from each Gujarati alphabet for example ? –???. Writing Exercises based on this Mathematics : Tables. Basic calculation Sum, Subtract, Multiplication, division in Gujarati. Writing problems for assessment of learning. Science : Prepare learning of science principles to sign language tutorials and writing exercises based on this. Conversion of Gujarati sentences to Sign Language and vice versa: If some Gujarati news/ articles are fed, they should be converted to sign language Conversion of speech to sign Language and vice versa: If some Gujarati conversation/addressing is taking place, they should be converted to sign language Data Analytics : Report card of the student to assess his/her learning of Mathematics and Science The application will cater to various users, including teachers, students, parents and HR(company). By integrating all these functions into a single Application , the application will address the lack of resources and bridge of communication gap. Teachers: Get a platform for teaching and can give repeated exercises to fine tune students with Mathematics and science. . Students: Learning platform where they can learn at their own pace and do the exercises. Parents: Helping aid for parents who do not know sign language. HR: Inclusivity is part of company policy also. While interviewing speech to text and text to speech will be helpful. Expected Solution: The implementation of this comprehensive Mobile application is expected to yield significant positive outcomes: Learning of Basic Mathematics and Science: Establishment of a unified platform where all relevant data is stored, reducing fragmentation and improving data accessibility. Increased Communication: Enhanced transparency in tracking progress and outcomes of various projects, facilitating better oversight and accountability. Better Assessment of learning: More effective allocation and utilization of resources, leading to improved outcomes for research and innovation projects. Including specially abled to mainstream : Conversion of text to sign language, speech to sign language and vice versa will narrow down the communication gap that arises due to non understanding of sign language. In summary, the proposed Mobile application aims to create a more efficient and supportive environment for learning to deaf and mute students in Gujarat. By addressing the current challenges and leveraging modern technology, the application will significantly enhance the learning ability of specially abled students.

EXISTING SYSTEM :

The existing system is smart glove is proposed which includes components such as flex sensors, Arduino, APR33A3 Voice Playback module, transmitter, and receiver. This technology helps the user to provide input in order to control his/her home appliances if he/she cannot walk towards the switchboard, which can be considered as an advantage. The disadvantage of this technology is that the device is bulky, and has too many components, making it hard to be a portable one. The working of the device commences as soon as there is an input in the form of a movement of hand or fingers. The gloves are connected to the flex sensors and if there is any input gesture given, then the sensor value changes as a result of the bend in the flex sensors. The changing value of the flex sensor corresponds to the applied bending angle as well as the resistance, according to the input given..

DISADVANTAGE :

Limited Access to Technology:Not all individuals in the deaf and mute community have access to smartphones, tablets, or computers, which could limit the app's reach and effectiveness. Variable Technology Literacy: Users may have different levels of comfort and proficiency with technology. Some may struggle to navigate the app effectively, which can hinder their learning experience. Diverse Sign Languages: Sign languages vary significantly between regions and communities. For instance, American Sign Language (ASL) is different from British Sign Language (BSL), and both differ from Indian Sign Language (ISL). This diversity can complicate the development of a universal sign language converter. Complexity of Sign Language: Sign language is not a direct translation of spoken language; it has its own grammar and syntax. An app that oversimplifies or misrepresents these aspects may lead to misunderstandings and poor learning outcomes.

PROPOSED SYSTEM :

the proposed system for sign language detection for deaf and dumb using flex sensor, gyroscope sensor, Bluetooth module, and LCD module Arduino Uno is a comprehensive solution that utilizes a combination of hardware and software components to recognize and interpret sign language gestures in real-time. The hardware components of the system include flex sensors and gyroscope sensors that are attached to a hand glove. The flex sensors are resistive sensors that change their resistance when they are bent. These sensors are attached to the fingers of the glove and detect the bending of the fingers. The gyroscope sensors, on the other hand, detect the orientation of the hand and the speed and direction of hand movements. These sensors work together to detect the movement and positioning of the hand and fingers, which is critical in recognizing and interpreting sign language gestures. The data collected by the sensors is then processed by the Arduino Uno microcontroller, which uses algorithms to recognize specific gestures and translate them into text.

ADVANTAGE :

improved Communication: The app can facilitate better communication between deaf individuals and those who do not know sign language, bridging the gap and fostering inclusion. Accessible Learning Resources: It provides easy access to learning materials, allowing users to learn at their own pace and convenience, which is especially beneficial for those who may not have access to traditional educational settings. Customized Learning Experience: Users can tailor their learning experience according to their preferences and needs, focusing on specific vocabulary or topics that are relevant to them. Visual Learning Support: The app can leverage visual aids, videos, and animations to enhance the learning experience, catering to the visual learning style that is often preferred in the deaf community.

Download DOC Download PPT

We have more than 145000 Documents , PPT and Research Papers

Have a question ?

Chat on WhatsApp