- MegaSuperAI
- Posts
- A Breakthrough in AI-Assisted Surgery
Hello, AI Fans!
This week we cover huge advancements in AI with a robot that has been trained by watching videos of surgeons successfully performing surgeries, demonstrating skills comparable to human doctors. We also delve into OpenAI’s forthcoming launch of ‘Operator’ in January 2025, an AI agent for automating tasks like coding and travel booking.
This week’s edition:
Robot Trained on Surgery Videos Matches Human Skills
OpenAI's 'Operator' Agent is on the Way
Your 5-Min AI Learning: Make Holiday Planning a Breeze with Wonderplan
New AI Tools
More AI News
AI Image of the Week
Read time: 8 minutes
LATEST NEWS
AI SURGICAL ROBOT
What you need to know: Researchers at Johns Hopkins University have successfully trained a surgical robot to perform procedures by watching videos of human surgeons. This breakthrough in imitation learning allows robots to execute surgical tasks as skillfully as human doctors, marking a significant step towards autonomous robotic surgery.
The finer details:
The team used the da Vinci Surgical System robot for their experiments.
The robot was trained to perform three fundamental surgical tasks: manipulating a needle, lifting body tissue, and suturing.
The training model combined imitation learning with machine learning architecture similar to ChatGPT with the researchers using hundreds of videos from wrist cameras on da Vinci robots during actual surgeries.
The model was trained to perform relative movements rather than absolute actions to overcome the da Vinci system's imprecision.
The robot demonstrated the ability to learn and generalise new environments with just a few hundred demonstrations.
So what? This advancement in training surgical robots could greatly speed up the development of autonomous systems by eliminating the need for manual coding of surgical steps. The method allows for rapid training across various procedures, potentially reducing medical errors and enhancing surgical accuracy. It also paves the way for more complex autonomous surgeries and broader applications of imitation learning in robotics, marking a significant leap forward that could revolutionise surgical practices in the near future.
OPENAI’S AI AGENT
What you need to know: OpenAI is set to launch 'Operator', a new AI agent capable of performing various tasks on behalf of users, such as coding and travel booking, by January 2025. This tool will be released as a research preview and through their API for developers, marking a significant step in the development of AI agents that can complete multi-step tasks with minimal human supervision.
The finer details:
'Operator' is designed to use a computer to take actions for users.
OpenAI has been working on several agent-related research projects.
The tool nearest completion will be a general-purpose agent that executes tasks in a web browser. This development represents a shift in the AI industry towards practical applications rather than just model advancement.
Other major tech companies like Anthropic, Microsoft, and Google are also developing similar technologies.
So what? AI agents like 'Operator' could transform how people interact with technology and manage daily tasks, potentially increasing competition in the AI market and accelerating advancements in agent technology. This shift may also heighten focus on ethical and privacy concerns regarding AI acting on behalf of users. Furthermore, it could indicate a new direction in AI development, as companies move from creating advanced models to developing practical, task-oriented applications that deliver real-world benefits.
YOUR 5 MIN AI LEARNING
Image Courtesy of Wonderplan
The tool chosen for this week’s AI learning section is one that I think may singlehandedly solve one of my problems, with holiday planning.
Wonderplan is an AI-powered travel planner that aims to take the hassle out of organising your holidays by crafting personalised itineraries. It considers what you like, your budget, and can suggest places to stay.
One of the coolest features? You can collaborate with whoever you are travelling with in real time, allowing you to discuss your plans and make changes on the fly (see what I did there ;)). Additionally, if you're looking to meet new people, Wonderplan lets you connect with fellow travellers who share your interests before you hit the road together. With all these handy tools, planning your next holiday becomes a breeze, making sure you focus on the fun stuff—like enjoying your adventure!
Definitely worth giving this tool a try, I know I will!
LATEST AI TOOLS
A tool to add text behind image subjects for overlays (free)
“Transform your designs with stunning text-behind-image effects. Simple, fast, and professional results in seconds.”
A tool to convert hand-drawn sketches into web applications without coding (waitlist sign up)
“Create apps by drawing. Start now—no coding needed!”
A tool to integrate chatbots for customer support on websites (freemium)
“Chirpbyte provides you the services of 1 on 1 live chat services and automated chat bots. Regardless of whether you need to integrate live chat into the website or looking for the best live chat software, you are in the right place.”
AI HIGHLIGHTS
A preliminary study presented at the American Heart Association's Scientific Sessions 2024 reveals that an AI-powered tool can provide quick, no-contact screenings for high blood pressure and diabetes by analysing high-speed video of the face and palm. Conducted in Japan, the system demonstrated 94% accuracy in detecting stage 1 hypertension and 75% accuracy for diabetes, using an algorithm that assesses blood flow changes. This innovative approach could enable individuals to monitor their health at home, facilitating early detection and treatment. However, further validation and development are needed before it can be widely implemented.
The International Rescue Committee (IRC) is using AI to improve humanitarian efforts through its Signpost project, which offers no-contact assistance to displaced individuals via multilingual chatbots. The initiative aims to reach half of the 117 million forcibly displaced people, enhancing accessibility and efficiency in delivering aid. However, concerns about data privacy and potential power imbalances underscore the need for careful implementation and community involvement.
Microsoft has introduced new AI models tailored for various industries, developed in collaboration with partners like Bayer and Rockwell Automation. These models, available through the Azure AI model catalogue, are designed to address specific organisational needs and enhance operational efficiency in sectors such as healthcare, agriculture, and manufacturing. By integrating these fine-tuned models with the Microsoft Cloud, businesses can leverage AI to tackle their most pressing challenges effectively.
A recent survey by ZestyAI found that 25% of insurers are using AI to assess risks associated with severe storms, reflecting a shift in managing climate-related threats. The study also revealed that 73% of insurance executives believe AI will be essential for addressing the increasing frequency of extreme weather events. Despite the growing adoption of AI, many still favour traditional actuarial models for risk assessment, highlighting a divide in the industry on the most effective approaches.
AI IMAGE OF THE WEEK
Lucky’s Adventure by Team MegaSuperAI
Can you feel it? Autumn has officially arrived, and with it comes a stunning transformation in nature. The leaves are changing, turning into a vibrant tapestry of reds, oranges, and golds. It’s that time of year when stepping outside feels like walking into an artist's masterpiece! Using this seasonal inspiration, we have created an Autumn day picture that reflects this!
The prompt used on Bing Image Creator:
“Autumn day within the forest during the day time looking over a small lake with different colour foliage. People walking their dog through the trees.”
FEEDBACK
 Teebs, your friendly AI assistant | That’s all folks. We hope you enjoyed this week’s newsletter. There’s more to come (especially as we build our AI Automation software service ReIgniteX AI) and we are excited to help you maximise AI in your life and business. |
Let us know how we did - shoot us a quick email. We read every single one (no AI in sight!).
If you enjoyed this newsletter please share with an awesome friend or two.
If you are that awesome friend then hit the below button: