Wingman AI

This page features some of my side projects, including potential startup ideas, hackathons, and learning initiatives.

Previous Projects

Wingman: A Personal AI Assistant

A Close Cousin of JARVIS from Iron Man

Dec 2022 – Present

Imagine if you could just tell your computer to do something for you, and get it done, much like JARVIS.

Wingman is an AI assistant that can do a variety of computer tasks for you across software, websites, and documents.

Wingman takes instructions in natural language via text or speech and a mouse pointer. It then applies computer vision to understand what’s happening on your screen and finally uses an AI model trained over thousands of human demonstrations to execute the task.

Things I learned:

  • AI models: Transformers, LLMs, RLHF, Speech-to-text conversion, LayoutLM.
  • Software engineering: Developing Mac desktop apps, multi-step API connectors.
  • Workplace automation Tools: Robotic Process Automation (RPA) and Workflow Automation.