WALL-M

• 

  Example of the main page, where you can prompt an LLM that responds according to the contents of your email database (with citations)

• 

  If you wish to ask further queries you can use the chat feature to obtain answers based on the most relevant context

• 

  DataViewer to view a summary of the emails loaded into the database

Inspiration

With the rise of Gen AI, we believe that now users should be able to access unstructured data in a much simpler fashion. Most people have many emails that they cannot often keep track of. For example, in investment/trading strategies, professionals rely on quick decisions leveraging as much information as possible. Similarly, senior employees in a startup dealing with many teams and disciplines might find it difficult to organize all the emails that they receive. These common problems can be solved using GenAI and help make their lives easier and more organized. The possibility of hallucinations in GenAI models can be scary and that's where RAG + Hybrid search comes in to save the day. This is what inspired us to build the product WALL-M ( Work Assistant LL-M)

What it does

You can load the emails from your inbox, and choose to filter by date and senders to define the context for the LLM. Then within the context, you can choose to make specific queries related to the chosen emails. Example 1, trading ideas based on select bank reports or investment research reports. Example 2, An employee in a company/startup can ask for a list of action items based on the work-emails they received over the last week.

How we built it

Frontend: Taipy

Backend: InterSystems Database, SQL

RAG + Vector Search: InterSystems Software, ChatGPT

Tools: LangChain, LlamaIndex

Challenges we ran into

Learning to work with the Python full-stack framework "TaiPy" Prompt optimization to avoid hallucinations Using LangChain to get a specific template that includes citations pointing to the source of the response/claim Incompatibilities between different tools we wanted to use

Accomplishments that we're proud of

Making a dynamic chat-based UI that is easy to use Integrating metadata filters to implement hybrid search and improve performance on top of RAG Find relevant use cases and make an end-to-end solution for the problem

What we learned

Hallucinations can be considerably reduced using a combination of RAG, LangChain and prompt optimization

What's next for Wall-M

Use the proof of concept for the specified use cases and evaluate its performance using benchmarks to validate the product's credibility. Improved integration into commonly used email applications such as Outlook and Gmail with personalized uses to improve the utility of WALL-M

Built With

• iris
• langchain
• openai
• python
• sqlalchemy
• taipy