An electrochemical process developed at Georgia Tech could offer new protection against bacterial infections without contributing to growing antibiotic resistance.

The approach capitalizes on the natural antibacterial properties of copper and creates incredibly small needle-like structures on the surface of stainless steel to kill harmful bacteria like E. coli and Staphylococcus. It’s convenient and inexpensive, and it could reduce the need for chemicals and antibiotics in hospitals, kitchens, and other settings where surface contamination can lead to serious illness.

It also could save lives: A global study of drug-resistant infections found they directly killed 1.27 million people in 2019 and contributed to nearly 5 million other deaths — making these infections one of the leading causes of death for every age group.

Researchers described the copper-stainless steel and its effectiveness May 20 in the journal Small.

Read the full story on the College of Engineering website.

Parth Arora is the founder of Third Dimension Fitness, a platform for gamified cardio through mixed reality, which was recently acquired by Elbo, an education-focused company based in Singapore. He began his company as a project in the summer of 2022. Since then, it has gained thousands of users and made thousands in revenue each month. Arora is a senior in computer science. He participated in the Spring 2024 Startup Launch, the first cohort to be held outside of the summer program. Below is a Q&A with Arora. 

Did you always want to be an entrepreneur?

I always did. I had my first company, an educational technology app, when I was 16, which ran for about two years. I ended it in my first year of college. I'm from India originally and the vision was to provide resources to the larger mass market of India for extracurricular activities. But, we realized there wasn't a business model. When we tried to make money, we started serving the rich kids. When we tried to serve the market, we didn't make money, which doesn't make investors happy, though we did end up making enough money to repay them.

That didn't stop me; it just gave me more lessons. 

What other experience in entrepreneurship have you had?

I've been involved in entrepreneurship communities at Georgia Tech forever. I was co-director of Startup Exchange, which is where I met a lot of really driven people. I got a chance to build their fellowship program and initiate their first pitch competition, which is now called Summit. I've collaborated with CREATE-X for different events, and I try to attend any event hosted by CREATE-X, Startup Exchange, or ATDC.

Why did you choose to join the spring cohort of Startup Launch this year?

CREATE-X provides everything you need, like legal support, financial support, sales support, mentors, and an introduction to VCs, which is why I decided to join the Launch program. I think all of that boosted our startup’s growth.

Why did you feel like acquisition was the way to go for your company?

I think because I always knew this wasn’t “the” thing I was going to do. This summer I'll be starting to work for Apple on their VisionPro team, and it has a direct conflict-of-interest. They wanted me to stop working on this for a while. So, I felt like this might be a good time to explore the acquisition.  We had really rich content, which had proven to work. We had curated that content after hundreds of customer interviews, and we had advisors from Nike, Disney, and Netflix. I knew that was a strong point, so that's why I knew that acquisition would be a good exit. 

What support have you had in taking the acquisition path?

Seth [Radman, who has had multiple exits himself and is a Startup Launch alumnus] has been guiding me professionally for a while. I met him at previous events through Startup Exchange, but then he recently came to a CREATE-X event. Rahul [Saxena, CREATE-X director], has also been a great support for me since day one. He was the one who suggested Startup Launch to me.

In December of last year, we started monetizing. We were testing different things. It was helpful to share the numbers and the data points with Rahul, mentors, and other people in my cohort so that I was not blindsided, and I could take actions based on the educated analysis of a database. It helped me drive down our customer acquisition cost, increase our customer lifetime value, and didn't keep me in my own bubble.

How were you okay with letting that product go?

It was a tough decision; it was my baby. I'd been working on it 10 to 15 hours a day, at least for the last few months. Rahul and Seth convinced me that if this is not the thing you want to do long-term and you know the market isn't big enough, you should move on to the next thing and put your time and energy there. 

I had to use my brain, and not my heart.

What's the biggest piece of advice that you've received as you developed your company?

Try to never lie to yourself, which is harder than it seems. I've built two companies and worked with several others, and I still lie to myself. When you love your product so much, it's very easy to lie to yourself about how there is a market for it, or people are using it. I think even in the future, I’ll probably be caught doing that, but the best way I've found to overcome that is to surround yourself with people who can tell you when you are doing it and help you see your company the way it is instead of the way you want it to be.

How has this decision affected you so far?

My lifestyle has completely changed, from looking at a dashboard every 10 to 15 minutes, seeing how the product is doing, and burning so many fires every 30 minutes, to being pretty chill. Like, what am I supposed to think about before I go to bed? What am I supposed to do now? Who are the customers I am supposed to be thinking about? It's been interesting, but I think this gives me space to now work on that next venture and have more time to think about what I want to do next.

Do you think you'll want to return to entrepreneurship in the future?

Yes, for sure. All the money I received from the acquisition will also fuel my next venture. My main goal is to grow in this industry. I'm an entrepreneur at heart, so I will be returning to the space soon or building products that people like. 

How are you celebrating this win?

I did celebrate it on our last day with Rahul, my amazing mentor, Margaret [Weniger, who founded Rising Tide], and the other cohort members. I will be celebrating it with a few of my friends because my 21st birthday is coming around, so I'll be celebrating these occasions together. 

But I don't want to take the money out from the company or for anything else, because it’s for my next venture. It shouldn't change my lifestyle at all, so I've kept all that money in a separate place.

What encouragement would you give to students interested in pursuing a startup?

Relative to other colleges, we have a cushion, a sense of security that we will get good jobs. Entrepreneurship is a riskier and more unpredictable path, which I've seen, and I'm personally experiencing right now having to choose between Big Tech versus entrepreneurship. But once you start building it and when you hear from your first customer how you affected the way they live, then there's no going back. Statistically, you'll probably fail, but you won't know until you start building; and if you do fail, it’ll teach you so many valuable lessons that are applicable in whatever career path you choose.

CREATE-X will launch its 12th cohort of Startup Launch on Aug. 29 at 5 p.m. in the Georgia Tech Exhibition Hall. Register today to secure your spot.

Interested in becoming a CREATE-X supporter? Startup Launch is made possible by contributions to Transforming Tomorrow, a $2 billion comprehensive campaign designed to secure resources that will advance the Institute and its impact, and by the continued engagement of our entrepreneurial ecosystem. Learn more about philanthropy at Georgia Tech and donate by visiting transformingtomorrow.gatech.edu.

To become a mentor in CREATE-X, visit the CREATE-X mentorship page. Any other inquiry may be sent to create-x@groups.gatech.edu. We appreciate your help and commitment to supporting our students in research and innovation.

Georgia Tech researchers say non-English speakers shouldn’t rely on chatbots like ChatGPT to provide valuable healthcare advice. 

A team of researchers from the College of Computing at Georgia Tech has developed a framework for assessing the capabilities of large language models (LLMs).

Ph.D. students Mohit Chandra and Yiqiao (Ahren) Jin are the co-lead authors of the paper Better to Ask in English: Cross-Lingual Evaluation of Large Language Models for Healthcare Queries. 

Their paper’s findings reveal a gap between LLMs and their ability to answer health-related questions. Chandra and Jin point out the limitations of LLMs for users and developers but also highlight their potential. 

Their XLingEval framework cautions non-English speakers from using chatbots as alternatives to doctors for advice. However, models can improve by deepening the data pool with multilingual source material such as their proposed XLingHealth benchmark.     

“For users, our research supports what ChatGPT’s website already states: chatbots make a lot of mistakes, so we should not rely on them for critical decision-making or for information that requires high accuracy,” Jin said.   

“Since we observed this language disparity in their performance, LLM developers should focus on improving accuracy, correctness, consistency, and reliability in other languages,” Jin said. 

Using XLingEval, the researchers found chatbots are less accurate in Spanish, Chinese, and Hindi compared to English. By focusing on correctness, consistency, and verifiability, they discovered: 

• Correctness decreased by 18% when the same questions were asked in Spanish, Chinese, and Hindi. 
• Answers in non-English were 29% less consistent than their English counterparts. 
• Non-English responses were 13% overall less verifiable. 

XLingHealth contains question-answer pairs that chatbots can reference, which the group hopes will spark improvement within LLMs.  

The HealthQA dataset uses specialized healthcare articles from the popular healthcare website Patient. It includes 1,134 health-related question-answer pairs as excerpts from original articles.  

LiveQA is a second dataset containing 246 question-answer pairs constructed from frequently asked questions (FAQs) platforms associated with the U.S. National Institutes of Health (NIH).  

For drug-related questions, the group built a MedicationQA component. This dataset contains 690 questions extracted from anonymous consumer queries submitted to MedlinePlus. The answers are sourced from medical references, such as MedlinePlus and DailyMed.   

In their tests, the researchers asked over 2,000 medical-related questions to ChatGPT-3.5 and MedAlpaca. MedAlpaca is a healthcare question-answer chatbot trained in medical literature. Yet, more than 67% of its responses to non-English questions were irrelevant or contradictory.  

“We see far worse performance in the case of MedAlpaca than ChatGPT,” Chandra said. 

“The majority of the data for MedAlpaca is in English, so it struggled to answer queries in non-English languages. GPT also struggled, but it performed much better than MedAlpaca because it had some sort of training data in other languages.” 

Ph.D. student Gaurav Verma and postdoctoral researcher Yibo Hu co-authored the paper. 

Jin and Verma study under Srijan Kumar, an assistant professor in the School of Computational Science and Engineering, and Hu is a postdoc in Kumar’s lab. Chandra is advised by Munmun De Choudhury, an associate professor in the School of Interactive Computing. 
 
The team will present their paper at The Web Conference, occurring May 13-17 in Singapore. The annual conference focuses on the future direction of the internet. The group’s presentation is a complimentary match, considering the conference's location.  

English and Chinese are the most common languages in Singapore. The group tested Spanish, Chinese, and Hindi because they are the world’s most spoken languages after English. Personal curiosity and background played a part in inspiring the study. 

“ChatGPT was very popular when it launched in 2022, especially for us computer science students who are always exploring new technology,” said Jin. “Non-native English speakers, like Mohit and I, noticed early on that chatbots underperformed in our native languages.” 

School of Interactive Computing communications officer Nathan Deen and School of Computational Science and Engineering communications officer Bryant Wine contributed to this report.

Four industry leaders have been named to the new board of the Georgia Institute of Technology’s Manufacturing 4.0 Consortium, cementing the first full year of the organization that works to build industry and research partnerships.

The Georgia Tech Manufacturing 4.0 Consortium is a membership-based organization connecting manufacturers, academia and government institutions at the university’s Advanced Manufacturing Pilot Facility in Midtown Atlanta. Members have unique opportunities to conduct research, develop and pilot new manufacturing systems and collaborate with students and other consortium members.

Members of the consortium’s board, announced earlier this month, include:

• Chuck Boyles (vice president, Factory Automation Systems)
• Branden Kappes (founder and president, Contextualize)

Additionally, the board has formed an industry membership committee led by:

• John Flynn (vice president of sales at Endeavor 3D, serving as Industry Membership chair)
• John Arroues (vice president of marketing at TRAK Machine Tools, serving as Industry Membership co-chair)

Consortium board members assist in fostering business relationships among the organization’s members, develop short- and long-term plans to align projects with emerging industry needs, work to make connections across industries, and advocate for consortium members to ensure the organization is meeting their needs and aligning with industry trends.

“The addition of these board members to the Manufacturing 4.0 Consortium cements this organization as a premier industry-academic partnership,” said Steven Ferguson, managing director of Georgia Artificial Intelligence in Manufacturing (Georgia AIM). Georgia AIM, a 4-year, $65 million federal grant program, serves as a catalyst for the consortium.

The grant is supporting an expansion of the Advanced Manufacturing Pilot Facility into a fully formed smart manufacturing space. As the facility expands to include new manufacturing technologies, members of the Manufacturing 4.0 Consortium will be able to access and test these systems for their own manufacturing needs.

“This is an exciting time at the facility. The expansion of the manufacturing space allows us to expand research into new projects that incorporate artificial intelligence and smart technologies,” added Ferguson. “And, with our consortium board members in place, it increases our ability to serve the manufacturing community.”

Launched in 2023, the Georgia Tech Manufacturing 4.0 Consortium aims to develop and deploy manufacturing technologies and workforce development opportunities. Consortium members gain the opportunity to accelerate product development, adopt and deploy industry 4.0 technologies, train the future workforce ad become global leaders using i4.0 solutions.

For more information on memberships, research opportunities, and the smart technologies planned for Georgia Tech’s Advanced Manufacturing Pilot Facilities, visit ampf.research.gatech.edu or contact Ferguson at sferguson@gatech.edu.

The call from his mom is still vivid 20 years later. Moments this big and this devastating can define lives, and for Hong Yeo, today a Georgia Tech mechanical engineer, this call certainly did. Yeo was a 21-year-old in college studying car design when his mom called to tell him his father had died in his sleep. A heart attack claimed the life of the 49-year-old high school English teacher who had no history of heart trouble and no signs of his growing health threat. For the family, it was a crushing blow that altered each of their paths. 

“It was an uncertain time for all of us,” said Yeo. “This loss changed my focus.” 

For Yeo, thoughts and dreams of designing cars for Hyundai in Korea turned instead toward medicine. The shock of his father going from no signs of illness to gone forever developed into a quest for medical answers that might keep other families from experiencing the pain and loss his family did — or at least making it less likely to happen.  

Yeo’s own research and schooling in college pointed out a big problem when it comes to issues with sleep and how our bodies’ systems perform — data. He became determined to invent a way to give medical doctors better information that would allow them to spot a problem like his father’s before it became life-threatening. 

His answer: a type of wearable sleep data system. Now very close to being commercially available, Yeo’s device comes after years of working on the materials and electronics for an easy-to-wear, comfortable mask that can gather data about sleep over multiple days or even weeks, allowing doctors to catch sporadic heart problems or other issues. Different from some of the bulky devices with straps and cords currently available for at-home heart monitoring, it offers the bonuses of ease of use and comfort, ensuring little to no alteration to users’ bedtime routine or wear. This means researchers can collect data from sleep patterns that are as close to normal sleep as possible.  

“Most of the time now, gathering sleep data means the patient must come to a lab or hospital for sleep monitoring. Of course, it’s less comfortable than home, and the devices patients must wear make it even less so. Also, the process is expensive, so it’s rare to get multiple nights of data,” says Audrey Duarte, University of Texas human memory researcher.  

Duarte has been working with Yeo on this system for more than 10 years. She says there are so many mental and physical health outcomes tied to sleep that good, long-term data has the potential to have tremendous impact. 

“The results we’ve seen are incredibly encouraging, related to many things —from heart issues to areas I study more closely like memory and Alzheimer’s,” said Duarte. 

Yeo’s device may not have caught the arrhythmia that caused his father’s heart attack, but nights or weeks of data would have made effective medical intervention much more likely.  

Inspired by his own family’s loss, Yeo’s life’s work has become a tool of hope for others.  

Faculty from the George W. Woodruff School of Mechanical Engineering, including Associate Professors Gregory Sawicki and Aaron Young, have been awarded a five-year, $2.6 million Research Project Grant (R01) from the National Institutes of Health (NIH). 

“We are grateful to our NIH sponsor for this award to improve treatment of post-stroke individuals using advanced robotic solutions,” said Young, who is also affiliated with Georgia Tech's Neuro Next Initiative.

The R01 will support a project focused on using optimization and artificial intelligence to personalize exoskeleton assistance for individuals with symptoms resulting from stroke. Sawicki and Young will collaborate with researchers from the Emory Rehabilitation Hospital including Associate Professor Trisha Kesar.

“As a stroke researcher, I am eagerly looking forward to making progress on this project, and paving the way for leading-edge technologies and technology-driven treatment strategies that maximize functional independence and quality of life of people with neuro-pathologies," said Kesar.

The intervention for study participants will include a training therapy program that will use biofeedback to increase the efficiency of exosuits for wearers.   

Kinsey Herrin, senior research scientist in the Woodruff School and Neuro Next Initiative affiliate, explained the extended benefits of the study, including being able to increase safety for stroke patients who are moving outdoors. “One aspect of this project is testing our technologies on stroke survivors as they're walking outside. Being outside is a small thing that many of us take for granted, but a devastating loss for many following a stroke.”  

Sawicki, who is also an associate professor in the School of Biological Sciences and core faculty in Georgia Tech's Institute for Robotics and Intelligent Machines, is also looking forward to the project. "This new project is truly a tour de force that leverages a highly talented interdisciplinary team of engineers, clinical scientists, and prosthetics/orthotics experts who all bring key elements needed to build assistive technology that can work in real-world scenarios."

Cardiologists and surgeons could soon have a new mobile augmented reality (AR) tool to improve collaboration in surgical planning.

ARCollab is an iOS AR application designed for doctors to interact with patient-specific 3D heart models in a shared environment. It is the first surgical planning tool that uses multi-user mobile AR in iOS.

The application’s collaborative feature overcomes limitations in traditional surgical modeling and planning methods. This offers patients better, personalized care from doctors who plan and collaborate with the tool.

Georgia Tech researchers partnered with Children’s Healthcare of Atlanta (CHOA) in ARCollab’s development. Pratham Mehta, a computer science major, led the group’s research.

“We have conducted two trips to CHOA for usability evaluations with cardiologists and surgeons. The overall feedback from ARCollab users has been positive,” Mehta said. 

“They all enjoyed experimenting with it and collaborating with other users. They also felt like it had the potential to be useful in surgical planning.”

ARCollab’s collaborative environment is the tool’s most novel feature. It allows surgical teams to study and plan together in a virtual workspace, regardless of location.

ARCollab supports a toolbox of features for doctors to inspect and interact with their patients' AR heart models. With a few finger gestures, users can scale and rotate, “slice” into the model, and modify a slicing plane to view omnidirectional cross-sections of the heart.

Developing ARCollab on iOS works twofold. This streamlines deployment and accessibility by making it available on the iOS App Store and Apple devices. Building ARCollab on Apple’s peer-to-peer network framework ensures the functionality of the AR components. It also lessens the learning curve, especially for experienced AR users.

ARCollab overcomes traditional surgical planning practices of using physical heart models. Producing physical models is time-consuming, resource-intensive, and irreversible compared to digital models. It is also difficult for surgical teams to plan together since they are limited to studying a single physical model.

Digital and AR modeling is growing as an alternative to physical models. CardiacAR is one such tool the group has already created. 

However, digital platforms lack multi-user features essential for surgical teams to collaborate during planning. ARCollab’s multi-user workspace progresses the technology’s potential as a mass replacement for physical modeling.

“Over the past year and a half, we have been working on incorporating collaboration into our prior work with CardiacAR,” Mehta said. 

“This involved completely changing the codebase, rebuilding the entire app and its features from the ground up in a newer AR framework that was better suited for collaboration and future development.”

Its interactive and visualization features, along with its novelty and innovation, led the Conference on Human Factors in Computing Systems (CHI 2024) to accept ARCollab for presentation. The conference occurs May 11-16 in Honolulu.

CHI is considered the most prestigious conference for human-computer interaction and one of the top-ranked conferences in computer science.

M.S. student Harsha Karanth and alumnus Alex Yang (CS 2022, M.S. CS 2023) co-authored the paper with Mehta. They study under Polo Chau, an associate professor in the School of Computational Science and Engineering.

The Georgia Tech group partnered with Timothy Slesnick and Fawwaz Shaw from CHOA on ARCollab’s development.

“Working with the doctors and having them test out versions of our application and give us feedback has been the most important part of the collaboration with CHOA,” Mehta said. 

“These medical professionals are experts in their field. We want to make sure to have features that they want and need, and that would make their job easier.”

Thanks to a Georgia Tech researcher's new tool, application developers can now see potential harmful attributes in their prototypes.

Farsight is a tool designed for developers who use large language models (LLMs) to create applications powered by artificial intelligence (AI). Farsight alerts prototypers when they write LLM prompts that could be harmful and misused.

Downstream users can expect to benefit from better quality and safer products made with Farsight’s assistance. The tool’s lasting impact, though, is that it fosters responsible AI awareness by coaching developers on the proper use of LLMs.

Machine Learning Ph.D. candidate Zijie (Jay) Wang is Farsight’s lead architect. He will present the paper at the upcoming Conference on Human Factors in Computing Systems (CHI 2024). Farsight ranked in the top 5% of papers accepted to CHI 2024, earning it an honorable mention for the conference’s best paper award.

“LLMs have empowered millions of people with diverse backgrounds, including writers, doctors, and educators, to build and prototype powerful AI apps through prompting. However, many of these AI prototypers don’t have training in computer science, let alone responsible AI practices,” said Wang.

“With a growing number of AI incidents related to LLMs, it is critical to make developers aware of the potential harms associated with their AI applications.”

Wang referenced an example when two lawyers used ChatGPT to write a legal brief. A U.S. judge sanctioned the lawyers because their submitted brief contained six fictitious case citations that the LLM fabricated.

With Farsight, the group aims to improve developers’ awareness of responsible AI use. It achieves this by highlighting potential use cases, affected stakeholders, and possible harm associated with an application in the early prototyping stage. 

A user study involving 42 prototypers showed that developers could better identify potential harms associated with their prompts after using Farsight. The users also found the tool more helpful and usable than existing resources. 

Feedback from the study showed Farsight encouraged developers to focus on end-users and think beyond immediate harmful outcomes.

“While resources, like workshops and online videos, exist to help AI prototypers, they are often seen as tedious, and most people lack the incentive and time to use them,” said Wang.

“Our approach was to consolidate and display responsible AI resources in the same space where AI prototypers write prompts. In addition, we leverage AI to highlight relevant real-life incidents and guide users to potential harms based on their prompts.”

Farsight employs an in-situ user interface to show developers the potential negative consequences of their applications during prototyping. 

Alert symbols for “neutral,” “caution,” and “warning” notify users when prompts require more attention. When a user clicks the alert symbol, an awareness sidebar expands from one side of the screen. 

The sidebar shows an incident panel with actual news headlines from incidents relevant to the harmful prompt. The sidebar also has a use-case panel that helps developers imagine how different groups of people can use their applications in varying contexts.

Another key feature is the harm envisioner. This functionality takes a user’s prompt as input and assists them in envisioning potential harmful outcomes. The prompt branches into an interactive node tree that lists use cases, stakeholders, and harms, like “societal harm,” “allocative harm,” “interpersonal harm,” and more.

The novel design and insightful findings from the user study resulted in Farsight’s acceptance for presentation at CHI 2024.

CHI is considered the most prestigious conference for human-computer interaction and one of the top-ranked conferences in computer science.

CHI is affiliated with the Association for Computing Machinery. The conference takes place May 11-16 in Honolulu.

Wang worked on Farsight in Summer 2023 while interning at Google + AI Research group (PAIR).

Farsight’s co-authors from Google PAIR include Chinmay Kulkarni, Lauren Wilcox, Michael Terry, and Michael Madaio. The group possesses closer ties to Georgia Tech than just through Wang.

Terry, the current co-leader of Google PAIR, earned his Ph.D. in human-computer interaction from Georgia Tech in 2005. Madaio graduated from Tech in 2015 with a M.S. in digital media. Wilcox was a full-time faculty member in the School of Interactive Computing from 2013 to 2021 and serves in an adjunct capacity today.

Though not an author, one of Wang’s influences is his advisor, Polo Chau. Chau is an associate professor in the School of Computational Science and Engineering. His group specializes in data science, human-centered AI, and visualization research for social good.  

“I think what makes Farsight interesting is its unique in-workflow and human-AI collaborative approach,” said Wang. 

“Furthermore, Farsight leverages LLMs to expand prototypers’ creativity and brainstorm a wide range of use cases, stakeholders, and potential harms.”

Two children are playing with a set of toys, each playing alone. That kind of play involves a somewhat limited set of interactions between the child and the toy. But what happens when the two children play together using the same toys?

“The actions are similar, but the choices and outcomes are very different because of the dynamic changes they’re making with the other person,” says Brian Magerko, Regents’ Professor in Georgia Tech’s School of Literature, Media, and Communication. “It’s a thing that humans do all the time, and computers don’t do with us at all.”

Welcome to the next frontier of artificial intelligence (AI) — not just generating but collaborating in real-time.

Magerko and his colleagues, Georgia Tech research scientist Milka Trajkova and Kennesaw State University Associate Professor of Dance Andrea Knowlton, are putting a collaborative AI system they’ve developed to the ultimate test: the world’s first collaborative AI dance performance.

Dance Partner

LuminAI is an interactive system that allows participants to engage in collaborative movement improvisation with an AI virtual dance partner projected on a nearby screen or wall. LuminAI analyzes participant movements and improvises responses informed by memories of past interactions with people. In other words, LuminAI learns how to dance by dancing with us.

The National Science Foundation-supported project began about 12 years ago in a lab and became an art installation and public demo. LuminAI has since moved into a different phase as a creative collaborator and education tool in a dance studio.

“We’re looking at the role LuminAI can play in dance education. As far as we’re aware, this is the first implemented version of an AI dancer in a dance studio,” says Trajkova, who was a professional ballet dancer before becoming a research scientist on the project.

To prepare LuminAI to collaborate with dancers, the research team started by studying pairs of improvisational dancers.

“We’re trying to understand how non-verbal, collaborative creativity occurs,” Knowlton says. “We start by trying to understand influencing factors that are perceived as contributing to improvisational success between two artists. Through that understanding, we applied those criteria to an AI system so it can have a similar experience with co-creative success.”

“We’re working on a creative arc,” adds Trajkova. “So instead of the AI agent just generating movements in response to the last thing that happened, we’re working to track and understand the dynamics of creative ideas across time as a continuous flow, rather than isolated instances of reaction.”

Students from Knowlton’s improvisational dance class at Kennesaw State spent two months of their spring semester working routinely with the LuminAI dancer and recording their impressions and experiences. One of the purposes the team discovered is that LuminAI serves as a third view for dancers and allows them to try ideas out with the system before trying it out with a partner.

The classroom experiment will culminate in a public performance on May 3 at Kennesaw State’s Marietta Dance Theater featuring the students performing with the LuminAI dancer. As far as the research team is aware the event is the world’s first collaborative AI dance performance.

While not all the dancers embraced having an AI collaborator, some of those who were skeptical at first left the experience more open to the possibility of collaborating with AI, Knowlton says. Regardless of their feelings toward working with AI, Knowlton says she believes the dancers gained valuable skills in working with specialized technology, especially as dance performances evolve to include more interactive media.

Refined Movement

So, what’s next for LuminAI? The project represents at least two possible paths for its learnings. The first includes continued exploration about how AI systems can be taught to cooperate and collaborate more like humans.

“With the advent of generative AI these past few years, it’s been really clear how great a need there is for this sort of social cognition,” says Magerko. “One of the things we’re going to be getting off the ground is sense-making with large language models. How do you collaborate with an AI system – rather than just making text or images, they’ll be able to make with us.”

The second involves the body movements LuminAI has been cataloging and analyzing over the years. Dance exemplifies highly refined motor skills, often exhibiting a level of detail surpassing that found in various athletic disciplines or physical therapy. While the tools designed to capture these intricate movements—through cameras and AI—are still nascent, the potential for harnessing this granular data is significant, Trajkova says.

That exploration begins on May 30 with a two-day summit being held at Georgia Tech to discuss its application for transforming performance athletics, with interdisciplinary participants in dance, computer vision, biomechanics, psychology, and human-computer interaction from Georgia Tech, Emory, KSU, Harvard, Royal Ballet in London, and Australian Ballet.

“It’s about understanding AI's role in augmenting training, promoting wellness as well as diving deep in decoding the artistry of human movements. How can we extract insights about the quality of athlete’s movements so we can help develop and enhance their own unique nuances?” Trajkova says.