Introduction: The Evolving Chain-of-thought In this post I focus on peer-reviewed papers from the last year or two. Most of these papers focus on techniques that aim to improve upon the commonly used chain-of-thought (CoT) approach, especially for tasks requiring complex reasoning. It鈥檚 not an exhaustive list by any means, but rather my summaries of papers I鈥檝e been reading recently. It鈥檚 worth noting that many of these papers use weaker LLMs than today鈥檚 top models....
Recently I evaluated the E5 embeddingds (there鈥檚 also a small and large versions). I got impressive results so thought I should read the paper behind it. I鈥檓 writing my summary here for myself and anyone else who might find it useful. Title: Text Embeddings by Weakly-Supervised Contrastive Pre-training This image was generated by DALL-E. The following text is human generated for the most part :) Idea This is a nice data paper....
Back to Blogging After a hiatus, I鈥檝e decided to give blogging another go. My previous blog was set up using Jekyll and hosted on GitHub. Since I blogged infrequently, I didn鈥檛 feel the need to explore other platforms. However, a recent shift in my attitude towards social media, specifically Twitter, and the ease of writing with GenAI, rekindled my interest in blogging. I yearned for a more aesthetic and user-friendly experience, leading me to transition my blog to Hugo, using the Papermod theme....
Introduction GPT4 was just released and it鈥檚 amazing. I use ChatGPT daily for all sorts of tasks, esp coding (in addition to Co-pilot etc.). I feel I now do more code reviews and apply fixes than actual coding. I鈥檝e seen posts on Twitter about the future of NLP and what problems are still worth tackling outside of large LMs. This is an interesting topic. I don鈥檛 have the answer. I do have some thoughts but instead of rambling I will show an example in a domain GPT4 knows well....