Catalysis Scientist
As part of the 2024 LLM Hackathon for Applications in Materials and Chemistry my colleagues Hampus Näsström Pepe Márquez Michael Götte and I worked on an exciting project to convert spoken instructions into Electronic Lab Notebook entries for NOMAD using the open Large Language Model Llama. Our project aims to facilitate the documentation of lab experiments using audio input and extracting the information into structured data entries. This solution provides a hands-free and efficient way to document lab experiments and write structured data entries into an Electronic Lab Notebook (ELN) based on the NOMAD schema. It is particularly useful for labs where manual documentation can be cumbersome or impractical because scientists might need both hands in the glovebox while experimenting. The use of a local instance of an LLM is very important, as these experiments protect the IP of the scientist. In this implementation, we used the Llama3:70b model served via Ollama protecting the privacy and still offering an efficient solution for the text processing and structuring (via function calling). You find the code on GitHub https://lnkd.in/eEeKkNQN Great experience and I learned a lot!
Research associate at University of Oxford
1moVery interesting!!