Build a Q&A bot of your website content with langchain

2 · Marc Päpper · March 11, 2023, 10:33 p.m.
If you want to learn how to create embeddings of your website and how to use a question answering bot to answer questions which are covered by your website, then you are in the right spot. We will approach this goal as follows: Use the website’s sitemap.xml to query all URLs Download the HTML of each URL and extract the text only Split each page’s content into a number of documents Embed each document using OpenAI’s API Create a vector store of these embeddings When asking a question, query whic...