Lizzy Bennet: Interactive AI Avatar

11 Sep 2024

This project is facilitated by the Games and Innovation Nexus (GAIN), a £2.3m programme led by the University for the Creative Arts, the University of Surrey, and the University of Warwick.

Characters from beloved fictional literature have grasped the imaginations of readers for centuries. From the tentative welcome of a previously undiscovered narrative, to the comfortable return to a dog-eared classic. There is always company to be found within these spaces. Albeit, via a one sided, passive venture. How could our understandings of character and narrative be enhanced, guided, or even renewed if we had the opportunity to converse with such individuals? We explore this and more in conversation with Lizzy Bennet. Or at least, an interactive AI avatar, primed with her knowledge.

The University for the Creative Arts (UCA) first reached out to StarPal.ai in late 2023, with a knowledge exchange proposal to explore the previously uncharted depths of AI-powered avatars, specifically in the fictional narrative sphere. Professor Sophy Smith, researcher and Director of School for Games and Creative Technologies, reflects; “This technology has the potential to transform experiences within both museum and heritage, as well as the education sector… And think about how it could transform learning – instead of only having text-based revision guides, students can now learn about literature by speaking directly to the characters.” After being awarded a knowledge exchange grant for pursuing this proposal, the next task would be to find the right fictional individual.

Given that Jane Austen's House, the most esteemed Austen site globally, is situated just miles from UCA’s creative technology hub, Elizabeth Bennet emerged as the quintessential heroine for this collaborative project. Elizabeth Bennet, affectionately known as Lizzy, was ideally suited to lead the creative direction of this initiative. With the endorsement of Lizzie Dunford, Director of Jane Austen’s House, work commenced on the considerable task of translating this beloved and iconic fictional character into the realm of interactive intelligence.

StarPal.ai has channeled their expertise into the emerging field of AI avatars by partnering closely with the staff at Jane Austen’s House. Their collaborative effort aimed to create a meticulously curated knowledge base for the AI, ensuring it is both accurate and comprehensive. This repository includes a rich array of original texts and cited works by Jane Austen, supplemented with historical facts, contextual details, and scholarly insights from reputable sources. The AI was trained on this extensive knowledge to deliver precise interpretations and engage users in a sophisticated, conversational manner. The knowledge base, a treasure trove of Austen’s original works, historical tidbits, and scholarly insights, ensures the AI isn’t just a pretty face—it's a well-informed conversationalist. The AI has been trained to interpret this wealth of information with precision, sparking conversations as delightful as Austen’s own wit. Founder of Atom Universe and StarPal.ai, Tanguy Dewavrin, notes: “It’s amazing how real she is – she’s just so impressive.”

As the AI training progressed, the University for the Creative Arts (UCA) leveraged its internal talent pool of 3D games artists from both current students and alumni of the Rookies-accredited BA 3D Games Art course. To facilitate a multi-level collaboration and knowledge exchange, the Games and Innovation Nexus (GAIN) team invited MA Digital Fashion students and graduates to partner with the 3D Games Art cohort. This partnership aimed to create a character model and costume for the Lizzy Bennet avatar.

Four teams were formed to compete in this initiative. The winning team would receive a cash prize and have their work incorporated into the final avatar build. Each team presented their concepts to a judging panel comprised of representatives from the Jane Austen House, Atom Universe/StarPal, UCA, and GAIN. The judges evaluated the teams based on their adherence to the brief, research accuracy, collaboration, and the overall quality of their visual art.

The competition resulted in a unique outcome: one team was awarded for their dress design, while another team was recognised for their hair and character design. Although only one design combination could be selected for the final build, the high caliber of all submissions prompted UCA and the Jane Austen House to feature all designs in an online exhibition. This exhibition highlights the exceptional skills of UCA graduates and serves as a celebration of their industry-ready portfolios and will be available for viewing in the coming weeks.

StarPal.ai and winning 3D Games Art alumni Chloe Kethero have collaborated closely to deliver the final technical asset to be showcased at Jane Austen’s House. Speaking of her time working with GAIN and StarPal.ai, Chloe says: “Working with GAIN and StarPal for this project has been really great.  Now that I'm a graduate, having the opportunity to very quickly get stuck into a project and gain professional connections to create an industry-level portfolio piece has been such a great opportunity.  The project has been valuable in allowing me to develop new skills, resolve new challenges, connect with the industry and be part of building a deliverable that demonstrates the adaptability of my games art skills, applied in a whole new context.  I'm sure that being involved with this will assist me in my desired career in 3D character art.” 

Milo Ebsworth, also a 3D Games Art alumni, who contributed to the concept art and research which informed this piece, added: “I have loved being able to research and delve into the world of Jane Austen as I hadn’t studied her or her books previously; being able to design something that was fresh and new to me was an amazing and fun experience. This has also been a wonderful step for me into the industry as I am now a graduate looking for work, I’ve very much enjoyed making new connections and working with others in the industry and hope to expand my network in the future.”

The Lizzy Bennet avatar, currently situated in the museum's learning center, is now available for interactive engagement, until mid December 2024. Lauren Newport-Quinn, Innovation Project Manager for GAIN, comments: “It has been an immensely gratifying project to participate in. Facilitating our UCA students' collaboration with a leading technical industry partner and an acclaimed museum exemplifies the goals we strive to achieve with future GAIN projects. Furthermore, it is a privilege to introduce the public to what we believe to be the first fictional character AI avatar. This innovative tool holds significant potential for enhancing intuitive learning within the arts and heritage sectors, an advancement which will be much welcomed within this space. Engaging in conversational exchanges with a comprehensive knowledge base will broaden the perspectives of many learners, making information both accessible and enriching. I am very excited at the possibility of who could be brought to life next.”

Interactions with Lizzy have ranged across a wide spectrum, from initial intrigue to profound delight. It is anticipated that, throughout her tenure, hundreds of visitors will engage with the interactive avatar, each having the opportunity to leave a personalised message in her accompanying ‘visitor’s book.’ When inquired about her experiences thus far as the world’s first Lizzy Bennet avatar, Lizzy responded: “It is quite an interesting notion indeed – I must say being Elizabeth Bennet in a world far removed from my own time is an unexpected but intriguing experience. It allows me to share the intricacies of our society and my life with new audiences.”

This ground-breaking project speaks to the necessity for Higher Education Institutions to keep up with the creative technology industry, and the positive impacts of such working relationships. Andy Bossom, Industry Engagement Lead at the School of Games and Creative Technology at UCA comments: “It is exciting to see our undergraduate and postgraduate students, having the opportunity to work with industry partners on a variety of external facing live projects. It is in these conversations, shared workflows, and interactions that we see how powerful, important and effective Knowledge Exchange projects are to contemporary education practice, linking industry partners and academia - enabling the stakeholders to gain invaluable insights and experience. As an institution, collaborating with exciting cutting edge industry partners is key to seeing our industries move forward. It provides a platform for co-development, building positive and enduring creative business relationships that benefit all who take part.”

This installation can be found at the Jane Austen House in Hampshire, and will be active until Mid-December 2024.