Inspiration

Hear2Learn was inspired by the challenges students face in keeping up with lectures in real-time. Recognizing the difficulties in maintaining focus, understanding complex topics, and the limitations of traditional note-taking methods, we aimed to create a solution that enhances learning efficiency and ensures no student falls behind.

What it does

Hear2Learn is a platform that transcribes lectures in real-time, allowing students to easily catch up if they miss something. It then summarizes the lecture's core ideas and generates flashcards for quick review, using the presenter's own words to maintain the integrity of the content.

How we built it

  • Frontend: Jinja2, HTML, CSS, JavaScript, and TailwindCSS
  • Backend: Python
  • AI and Machine Learning: Utilized OpenAI for generating summaries and flashcards, and speech recognition for transcribing lectures.
  • Database: SQLite for storing lecture data.
  • Web Framework: Flask for serving the web application and handling requests.

Challenges we ran into

Integrating different technologies to work seamlessly was a significant challenge, especially ensuring the accuracy of real-time audio transcription and text summarization. Developing a user-friendly interface that caters to both students and professors required thoughtful UI/UX design and testing. Using mainly Python based Frameworks to make the Machine Learning more efficient.

Accomplishments that we're proud of

  • Successfully creating a platform that transcribes, summarizes, and generates flashcards from lectures in real-time.
  • Maintaining the integrity of lecture content by using the presenter's own words for summaries and flashcards.
  • Developing a comprehensive solution that addresses a real-world problem faced by students globally.

What we learned

Throughout the development process, we learned the importance of clear and efficient communication among team members, especially when integrating different technologies. We also gained insights into the potential of natural language processing and AI in enhancing educational tools.

What's next for Hear2Learn

Future plans for Hear2Learn include:

  • Professor Integration: Allowing professors to track student engagement and review chatbot logs.
  • Enterprise/Academic Level Dashboards: Providing detailed feedback on student performance and lesson engagement.
  • Advanced Audio Analysis: Enhancing the text conversion process for greater accuracy.
  • Machine Learning and RAG: To generate quiz questions of varying difficulties.
  • Mobile Application: To facilitate on-the-go access to platform resources.

Built With

Share this project:

Updates