Skip to content

Conversion of Pitch and Color Spectrum Ratios for the AI-Driven Reinterpretation of Traditional Cultural Heritage in Contemporary Artistic Practices

 

Project no.: S-PD-25-9

Project description:

Project researcher intern – Dr. Vytautas Germanavičius, internship supervisor – Prof. Dr. Agnė Paulauskaitė-Tarasevičienė.
The main task of the study is to develop a method to convert sound-to-colour ratios and determine the colours in a black-and-white photograph then to compare them detecting similarities or differences; to create a method how to integrate the results of the research into composition, a models of sound structures related to colour patterns, forming a synthesis of traditional cultural heritage and contemporary creative practices in art work creation and music composition. It is important to note that the performance of sound and visual instalation with a acoustic instruments, uses generative sound technologies, which modify the interpretation techniques of a piece of music by synchronising the distribution of audio and visual elements in particular space. The project plans to use state-of-the-art technologies to achieve results, using Kaunas University of Technology, Artificial Inteligence Excellence Centre bases and the world’s latest technological facilities and innovations. The entities or groups that may be interested in the results obtained during the project: Universities and research centers in fields such as musicology, ethnomusicology, neuroscience, visual arts, and artificial intelligence on sound–color relationships, synesthesia, and AI applications in interdisciplinary research. Contemporary composers, visual artists, and multimedia creators exploring cross-modal, or AI-driven practices. Institutions involved in arts and STEAM education can use the project’s interdisciplinary approach as a model for integrating science, technology, art, and tradition. Visitors to the final audiovisual installation and performances especially those interested in multisensory art experiences, Lithuanian identity, or innovative uses of AI represent an important stakeholder group in terms of public impact and cultural outreach.

Project funding:

Research Council of Lithuania, Projects of Postdoctoral fellowships funded by the state budget of the Republic of Lithuania


Project results:

The results of the research will be presented in several forms: scientific paper, report, public performance: 1. An Article in a Scientific journal, the results of the recent study will be presented, which methods and techniques was chosen of implementing the research results in the art work using a new technology – generative AI and computer applications, the analyses of the coreleation beetween models of colour and sound structures in compositions, that created a synthesis of traditional cultural heritage in new technological enviroment in Lietuvos muzikologija (Lithuanian Musicology), published by the Publishing House of the Lithuanian Academy of Music and Theatre (Web of Sciences or Scopus databases), 2027, which focuses on Classics and avant-garde, heritage re-assessment and music extensions in contemporaneity by openness to the diversity of contemporary music history and artistic research. https://žurnalai.lmta.lt/en/journal/lithuanian-musicology/
2. An Article in a Scientific journal, the results of the recent study will be presented, how process of audio text information and generative analysis method to process of visual text information was used to compare colour spectrum of pitch and interval conversion with the extracted colours of fabrics, and outcome and the results, the second publication in WofS or Scopus which focuses on Art, science, and technology intersections — generative music, auditory synthesis, artistic practices.
3. A presentation at the international symposium “Mikrotöne ~ Microtones Small is Beautiful” (University of Salzburg). The symposium is organised by the International Society of Ekmelic Music was founded in Salzburg in 1981 and is part of a worldwide network of microtonal music organisations, whose aim is the dissemination of microtonal music through concerts, conferences, the publication of research articles and scores, and the promotion of microtonal music worldwide http://www.ekmelic-music.org/en/ges.htm.
4. Performance of the multidisciplinary artwork that combines integrated reseach with technologies in the international GAIDA Festival that takes place in Vilnius since 1991 is the main, the largest and the most prominent festival of contemporary music in Lithuania and in all Baltic countries. This is one of the most important music forums in Central and Eastern Europe. Events of the GAIDA Festival are always associated with new ideas of modern times, highest quality and artistic innovations.https://www.vilniusfestivals.lt/en/
5. Performance of the multidisciplinary artwork at contemporary music festival Klangspuren Schwaz which focuses on the relationship between humans and technology and invites us to explore our emotional approach to digital innovations in new ways. https://klangspuren.at/en/festival/

Period of project implementation: 2026-01-15 - 2028-01-14

Project coordinator: Kaunas University of Technology

Head:
Vytautas Germanavičius

Duration:
2026 - 2028

Department:
Artificial Intelligence Centre of Excellence