Skip to main content

2025 Key Research Areas

The research landscape in early 2025:


  • Research Assistant Development
  • Vision Model Improvements
  • Coding Agent 
  • Post-Training applied Reinforcement Learning
  • Enhanced Embedding Model
  • Tokenization Methods Refinement
  • Data Structures Optimization
One of my goal is to create an efficient workflow using research and coding agents to handle routine tasks, while I focus on providing direction in critical areas.

At the same time, I am also trying to become a lazy YouTuber with my language model based agents handling the majority of the routine workload. My first task was to find agood toool to generate videos off of the research papers in a creative and entertaining manner. 

I've evaluated several voice/text-to-video generation tools, but found most lack intuitive interfaces or sufficient versatility. The market shows numerous platforms with similar capabilities but limited innovation. While many of these tools effecively serve their original purpose, they generally haven't expanded into more comprehensive toolsets that address broader needs in seamless ways. 

Ongoing Evaluations: 

(More to follow...)













Comments

Post a Comment

Popular posts from this blog

2024 Progress...

My team has made considerable advancements in applying various emerging technologies for IMG (Investment Management Group). Predictive Models We have transitioned from conventional methods and refined our approach to using alternative data to more accurately predict the CPI numbers. Our initial approach has not changed by using 2 models (top-down & bottoms-up) for this prediction.   So far we have outperformed both our larger internal team and major banks and dealers in accurately predicting the inflation numbers. Overall roughly 80% accuracy with the last 3 month prediction to be right on the spot.  We have also developed predictive analytics for forecasting prepayment on mortgage-backed securities and predicting macroeconomic regime shifts. Mixed Integer Programming  / Optimization Another area of focus is on numerical optimization to construct a comprehensive portfolio of fixed-income securities for our ETFs and Mutual Funds. This task presents numer...
Post a Comment
Read more

What matters?

 What matters? Six things that matter in LLM in July 2024. 1) Scale of the model, number of parameters: Scale with brute force alone won't work. But the scale does matter depending on the overall goal and the purpose of what the LLM is trying to solve.   2) Compute matters: Even more than ever, we need to look at the infrastructures around LLMs. Infrastructure is also one of the main constraints for the near term and strategically provides an advantage to a few Middle East countries. 3) Data, quality & quantity. It remains true that high-quality data with extensive (longer) training is the way. Quantity of the data also matters. 4) Loss function matters: If your loss function isn't sophisticated or incentivizes the "right" thing, you will have limited improvement. 5) Symmetry or architecture: Do you have the correct architecture around your model(s) and data? Inefficient engineering can be costly to the overall performance and output. There are inherent structural...
Post a Comment
Read more

Research Paper on MoA (Mixture of Agents)

Despite one-year setback... MoA is All You Need: Building LLM Research Team using Mixture of Agents My first attempt at using NotebookLM to create the podcast from research papers. YouTube  url on the research paper. Currently looking for ways to improve my consumption of the relevant research papers. Anyone know of a good platform that can turn the .wav files to realistic video?
Post a Comment
Read more