OpenAI o1 Model in Chunk AI and what’s next for 2025
Happy New Year everyone! Sorry for the delay, there’s been a lot happening since my last post, including my city being on fire. 😢 Thankfully, my family and I are fine, but there are many others really suffering. My heart goes out to them and everyone dealing with this horrific experience.
Somehow, I was still able to deliver a couple of updates already this year for Chunk.
Improvements/Bug Fixes
I’ve made a lot of under-the-hood improvements to Chunk during the holiday break, including fixing a nasty document uploading bug, improving and updating image analysis for each respective company model, and cleaning up a lot of the UI on iOS, iPad OS, and macOS (still more UI improvements on macOS to do).
New Features
Collections got some updates recently. Now you can store conversations from Chat into Collections to help organize your work or research. You’ll also see summaries of each Collection you’ve made. When you add new conversations with additional context, the summaries will update as well. It’s really helpful when you come back to some work after a few days and want to know what was said in a Chat without having to read through them all.
I also decided to stop showing the paywall every time free users leave the Chat tab and come back. Even though this will probably cost me more money in the short term, I try to build things that I would want to use, and having that paywall pop up every time is very annoying and wouldn’t give me a great feeling about the app I’m using, even though it was free. It’s up to me to continue to provide value for users to want to upgrade, even if access to all of the leading AI models is already a great value for the price. 😜 I appreciate EVERYONE who is or has subscribed to Chunk. It’s what allows me to keep working on it and pay my bills. lol. I don’t have any VC backing, so I rely solely on my users, and I don’t want to take that for granted, even if you’re using Chunk for free.
OpenAI o1 Reasoning Model
It’s finally here! I mentioned that the production version of OpenAI’s latest and most powerful AI ‘reasoning’ model was coming soon to Chunk. OpenAI is slowly rolling out access to companies using their API. Chunk was luckily one of the early companies to get access. So as soon as I was able to, I added it to Chunk, officially in the v1.8.1 release.
This is my go-to model for any complex problems I have, including hard coding problems I run into and debugging code. I find it so much more capable and helpful than any other model for logic-based problems—Math, Coding, Science, and even distilling info from research.
However, o1 is very expensive to run, and I constantly run into OpenAI’s usage limits. Now that it’s in Chunk, I’ll be able to use it more…but Chunk will also have some limits on o1 usage, at least for now. Subscribers will get 10 searches per day when using the o1 model. These limits can and probably will change over time. Hopefully, prices will come down, and I can increase or totally remove the usage limits. There are some interesting use cases I’m experimenting with, integrating o1 deeper into Chunk. Exciting times.
What’s Next…
I’m currently deep into prototyping a new feature I’m working on for Chunk AI that uses OpenAI’s Realtime (voice) API that I’m super excited about! I won’t get into details because there’s still a lot of technical and business decisions to be made and code to be written. The goal is to make it even easier for users to have a literal dialog with their documents (and possibly other media). Whether it’s for research, search, work, homework, or studying, I want Chunk AI to be the first app you think of.
I’m also working on a rethink of the contextual documents side panel on iPadOS and macOS. I’ve gotten some feedback since Chunk’s initial release and users want more from this feature, so I’m totally rethinking how referenced content will appear there and what can be done with it that would help support how users are using Chunk for their work. Stay tuned!