{"id":853,"date":"2023-11-01T13:20:58","date_gmt":"2023-11-01T13:20:58","guid":{"rendered":"https:\/\/todaysainews.com\/index.php\/2023\/11\/01\/predicting-the-past-with-ithaca\/"},"modified":"2025-04-27T07:31:53","modified_gmt":"2025-04-27T07:31:53","slug":"predicting-the-past-with-ithaca","status":"publish","type":"post","link":"https:\/\/todaysainews.com\/index.php\/2023\/11\/01\/predicting-the-past-with-ithaca\/","title":{"rendered":"Predicting the past with Ithaca"},"content":{"rendered":"<p> [ad_1]<br \/>\n<\/p>\n<div>\n<div class=\"article-cover article-cover--centered\">\n<div class=\"article-cover__header\">\n<p class=\"article-cover__eyebrow glue-label\">Research<\/p>\n<dl class=\"article-cover__meta\">\n<dt class=\"glue-visually-hidden\">Published<\/dt>\n<dd class=\"article-cover__date glue-label\">\n              <time datetime=\"2022-03-09\"><br \/>\n                9 March 2022<br \/>\n              <\/time>\n            <\/dd>\n<dt class=\"glue-visually-hidden\">Authors<\/dt>\n<dd class=\"article-cover__authors\">\n<p data-block-key=\"ecnxv\">Yannis Assael, Thea Sommerschield *, Brendan Shillingford, Nando de Freitas (*external authors)<\/p>\n<\/dd>\n<\/dl>\n<section class=\"glue-social glue-social--zippy share share--centered article-cover__share\" data-glue-expansion-panel-expand-tooltip=\"Share: Expand to see social channels\" data-glue-expansion-panel-collapse-tooltip=\"Share: Hide social channels\" id=\"share-854aaada-c6e5-47ac-a741-ce8150d06751\">\n<\/section><\/div>\n<picture class=\"article-cover__image\"><source media=\"(min-width: 1024px)\" type=\"image\/webp\" width=\"1072\" height=\"603\" srcset=\"https:\/\/lh3.googleusercontent.com\/kwhR6u6cuHPNVvD4XfCT2UyDnrTJ_ZSVJG8U5XlNPxfEnht3fsTDaBqwpEMesFrzeWro0cSya7rS_aD_W2zTNZOb9TOAx_Vo9HTUOTiAHdGaWz_y=w1072-h603-n-nu-rw 1x, https:\/\/lh3.googleusercontent.com\/kwhR6u6cuHPNVvD4XfCT2UyDnrTJ_ZSVJG8U5XlNPxfEnht3fsTDaBqwpEMesFrzeWro0cSya7rS_aD_W2zTNZOb9TOAx_Vo9HTUOTiAHdGaWz_y=w2144-h1206-n-nu-rw 2x\"\/><source media=\"(min-width: 600px)\" type=\"image\/webp\" width=\"928\" height=\"522\" srcset=\"https:\/\/lh3.googleusercontent.com\/kwhR6u6cuHPNVvD4XfCT2UyDnrTJ_ZSVJG8U5XlNPxfEnht3fsTDaBqwpEMesFrzeWro0cSya7rS_aD_W2zTNZOb9TOAx_Vo9HTUOTiAHdGaWz_y=w928-h522-n-nu-rw 1x, https:\/\/lh3.googleusercontent.com\/kwhR6u6cuHPNVvD4XfCT2UyDnrTJ_ZSVJG8U5XlNPxfEnht3fsTDaBqwpEMesFrzeWro0cSya7rS_aD_W2zTNZOb9TOAx_Vo9HTUOTiAHdGaWz_y=w1856-h1044-n-nu-rw 2x\"\/><source type=\"image\/webp\" width=\"528\" height=\"297\" srcset=\"https:\/\/lh3.googleusercontent.com\/kwhR6u6cuHPNVvD4XfCT2UyDnrTJ_ZSVJG8U5XlNPxfEnht3fsTDaBqwpEMesFrzeWro0cSya7rS_aD_W2zTNZOb9TOAx_Vo9HTUOTiAHdGaWz_y=w528-h297-n-nu-rw 1x, https:\/\/lh3.googleusercontent.com\/kwhR6u6cuHPNVvD4XfCT2UyDnrTJ_ZSVJG8U5XlNPxfEnht3fsTDaBqwpEMesFrzeWro0cSya7rS_aD_W2zTNZOb9TOAx_Vo9HTUOTiAHdGaWz_y=w1056-h594-n-nu-rw 2x\"\/><img loading=\"lazy\" decoding=\"async\" alt=\"\" height=\"603\" src=\"https:\/\/lh3.googleusercontent.com\/kwhR6u6cuHPNVvD4XfCT2UyDnrTJ_ZSVJG8U5XlNPxfEnht3fsTDaBqwpEMesFrzeWro0cSya7rS_aD_W2zTNZOb9TOAx_Vo9HTUOTiAHdGaWz_y=w1072-h603-n-nu\" width=\"1072\"\/>\n    <\/picture>\n<\/p><\/div>\n<div class=\"gdm-rich-text rich-text\">\n<p data-block-key=\"ojxte\"><b>Restoring, placing, and dating ancient texts through collaboration between AI and historians<\/b><\/p>\n<p data-block-key=\"nkxge\">The birth of human writing marked the dawn of <a href=\"https:\/\/en.wikipedia.org\/wiki\/History#History_and_prehistory\" rel=\"noopener\" target=\"_blank\">History<\/a> and is crucial to our understanding of past civilisations and the world we live in today. For example, more than 2,500 years ago, the Greeks began writing on stone, pottery, and metal to document everything from leases and laws to calendars and oracles, giving a detailed insight into the Mediterranean region. Unfortunately, it\u2019s an incomplete record. Many of the surviving inscriptions have been damaged over the centuries or moved from their original location. In addition, modern dating techniques, such as <a href=\"https:\/\/en.wikipedia.org\/wiki\/Radiocarbon_dating\" rel=\"noopener\" target=\"_blank\">radiocarbon dating<\/a>, cannot be used on these materials, making inscriptions difficult and time-consuming to interpret.<\/p>\n<p data-block-key=\"ks6gb\">In line with <a href=\"https:\/\/deepmind.com\/about\" rel=\"noopener\" target=\"_blank\">DeepMind\u2019s mission<\/a> of solving intelligence to advance science and humanity, we collaborated with the <a href=\"https:\/\/www.unive.it\/pag\/27720\/\" rel=\"noopener\" target=\"_blank\">Department of Humanities of Ca&#8217; Foscari University of Venice<\/a>, the <a href=\"https:\/\/www.classics.ox.ac.uk\/\" rel=\"noopener\" target=\"_blank\">Classics Faculty of the University of Oxford<\/a>, and the <a href=\"https:\/\/www.dept.aueb.gr\/en\/infotech-overview-en\" rel=\"noopener\" target=\"_blank\">Department of Informatics of the Athens University of Economics and Business<\/a> to explore how machine learning can help historians better interpret these inscriptions \u2013 giving a richer understanding of ancient history and unlocking the potential for cooperation between AI and historians.<\/p>\n<p data-block-key=\"kwsb7\">In a <a href=\"https:\/\/www.nature.com\/articles\/s41586-022-04448-z\" rel=\"noopener\" target=\"_blank\">paper<\/a> published today in <i>Nature<\/i>, we jointly introduce Ithaca, the first deep neural network that can restore the missing text of damaged inscriptions, identify their original location, and help establish the date they were created. Ithaca is named after the Greek island in <a href=\"https:\/\/en.wikipedia.org\/wiki\/Odyssey\" rel=\"noopener\" target=\"_blank\">Homer\u2019s <i>Odyssey<\/i><\/a> and builds upon and extends <a href=\"https:\/\/deepmind.com\/research\/publications\/2019\/Restoring-ancient-text-using-deep-learning-a-case-study-on-Greek-epigraphy\" rel=\"noopener\" target=\"_blank\">Pythia<\/a>, our previous system that focused on textual restoration. Our evaluations show that Ithaca achieves 62% accuracy in restoring damaged texts, 71% accuracy in identifying their original location, and can date texts to within 30 years of their ground-truth date ranges. Historians have already used the tool to reevaluate significant periods in Greek history.<\/p>\n<p data-block-key=\"936nx\">To make our research widely available to researchers, educators, museum staff and others, we partnered with <a href=\"https:\/\/cloud.google.com\/\" rel=\"noopener\" target=\"_blank\">Google Cloud<\/a> and <a href=\"https:\/\/artsandculture.google.com\/\" rel=\"noopener\" target=\"_blank\">Google Arts &amp; Culture<\/a> to launch a <a href=\"https:\/\/ithaca.deepmind.com\/\" rel=\"noopener\" target=\"_blank\">free interactive version of Ithaca<\/a>. And to aid further research, we have also <a href=\"https:\/\/github.com\/deepmind\/ithaca\" rel=\"noopener\" target=\"_blank\">open sourced<\/a> our code, the pretrained model, and an interactive Colaboratory notebook.<\/p>\n<\/div>\n<figure class=\"single-media single-media--inline\"><figcaption class=\"single-media__caption\">\n<p data-block-key=\"p81qx\">Figure 1. This restored inscription (IG I3 4B) records a decree concerning the Acropolis of Athens and dates 485\/4 BCE. (CC BY-SA 3.0, WikiMedia).<\/p>\n<\/figcaption><\/figure>\n<figure class=\"single-media single-media--inline\"><figcaption class=\"single-media__caption\">\n<p data-block-key=\"pmrh2\">Figure 2. Ithaca&#8217;s architecture. Damaged parts of a text are represented with a dash &#8220;-&#8220;. Here, we artificially corrupted the characters &#8220;\u03b4\u03b7\u03bc.&#8221; Provided with these inputs, Ithaca restores the text, and identifies the time and place in which the text was written.<\/p>\n<\/figcaption><\/figure>\n<div class=\"gdm-rich-text rich-text\">\n<h2 data-block-key=\"08n47\">Collaborative tools<\/h2>\n<p data-block-key=\"epphq\">Ithaca is trained on the <a href=\"https:\/\/inscriptions.packhum.org\/\" rel=\"noopener\" target=\"_blank\">largest digital dataset of Greek inscriptions<\/a> from the <a href=\"https:\/\/packhum.org\/\" rel=\"noopener\" target=\"_blank\">Packard Humanities Institute<\/a>. <a href=\"https:\/\/en.wikipedia.org\/wiki\/Natural_language_processing\" rel=\"noopener\" target=\"_blank\">Natural language processing<\/a> models are commonly trained using words because the order in which they appear in sentences and the relationships between them provide extra context and meaning. For example, \u201conce upon a time\u201d has more meaning than each character or word seen separately. However, many of the inscriptions historians are interested in analysing with Ithaca are damaged and often missing chunks of text. To ensure our model still works when presented with one of these, we trained it using both words and the individual characters as inputs. The sparse self-attention mechanism at the model\u2019s core evaluates these two inputs in parallel, allowing Ithaca to evaluate inscriptions as needed.<\/p>\n<\/div>\n<figure class=\"single-media single-media--inline\"><figcaption class=\"single-media__caption\">\n<p data-block-key=\"odler\">Figure 3. Ithaca\u2019s outputs. (a) Restoration predictions for 6 missing characters (dashes) in an Athenian inscription (IG II2 116). The top restoration, in green, is correct (\u03c3\u03c5\u03bc\u03bc\u03b1\u03c7\u03af\u03b1, &#8220;alliance&#8221;). Note how the following hypotheses (\u1f10\u03ba\u03ba\u03bb\u03b7\u03c3\u03af\u03b1, &#8220;assembly&#8221; and \u03c0\u03c1\u03bf\u03be\u03b5\u03bd\u03af\u03b1, &#8220;treaty between State and foreigner&#8221;), highlighted in red, typically occur in Athenian political decrees, revealing Ithaca&#8217;s receptivity to context. (b) Geographical attribution of an inscription from Amorgos (IG XII 7, 2). Ithaca&#8217;s top prediction is correct, and the closest predictions are neighbouring regions. (c) Date distribution for an inscription from Delos (IG XI 4, 579). The ground-truth date interval 300-250 BCE is in grey; Ithaca&#8217;s predicted distribution is in yellow and has a mean at 273 BCE (in green).<\/p>\n<\/figcaption><\/figure>\n<div class=\"gdm-rich-text rich-text\">\n<p data-block-key=\"gcge2\">To maximise Ithaca&#8217;s value as a research tool, we also created a number of visual aids to ensure Ithaca\u2019s results are easily interpretable by historians:<\/p>\n<ul>\n<li data-block-key=\"bbkx1\"><b>Restoration hypotheses<\/b>: Ithaca generates several prediction hypotheses for the text restoration task for historians to choose from using their expertise.<\/li>\n<li data-block-key=\"4aj73\"><b>Geographical attribution<\/b>: Ithaca shows its uncertainty by giving historians a probability distribution over all possible predictions \u2013 instead of just a single output. As a result, it returns probabilities for 84 different ancient regions representing its level of certainty. It visualises these results on a map to shed light on possible underlying geographical connections across the ancient world.<\/li>\n<li data-block-key=\"93599\"><b>Chronological attribution<\/b>: When dating a text, Ithaca produces a distribution of predicted dates across all decades from 800 BCE to 800 CE. This can enable historians to visualise the model\u2019s confidence for specific date ranges, which may offer valuable historical insights.<\/li>\n<li data-block-key=\"9vbqe\"><b>Saliency maps<\/b>: To convey the results to historians, Ithaca uses a technique commonly used in computer vision that identifies which input sequences contribute most to a prediction. The output highlights the words in different colour intensities that led to Ithaca\u2019s predictions for missing text, location and dates.<\/li>\n<\/ul>\n<\/div>\n<figure class=\"single-media single-media--inline\"><figcaption class=\"single-media__caption\">\n<p data-block-key=\"bg6h7\">Figure 4. This text (IG II2 116, Athens 361\/0 BCE) records an alliance between the people of Athens and Thessaly. By using saliency maps, we can visualise Ithaca &#8220;focusing&#8221; on the contextually important words \u2018Athenians\u2019 and \u2018Thessalians\u2019 when restoring the corrupted word \u2018alliance\u2019.<\/p>\n<\/figcaption><\/figure>\n<div class=\"gdm-rich-text rich-text\">\n<h2 data-block-key=\"oxlec\">Contributing to historical debates<\/h2>\n<p data-block-key=\"znoht\">Our experimental evaluation shows how Ithaca\u2019s design decisions and visualisation aids make it easier for researchers to interpret results. The expert historians we worked with achieved 25% accuracy when working alone to restore ancient texts. But, when using Ithaca, their performance increases to 72%, surpassing the model\u2019s individual performance and showing the potential for human-machine cooperation to advance historical interpretation, establish relative datings for historical events, and even contribute to current methodological debates.<\/p>\n<p data-block-key=\"h9yyc\">For example, historians currently disagree on the date of a series of important <a href=\"https:\/\/staff.mq.edu.au\/teach\/teaching-macquarie\/ancient-history-for-schools\/greece-resources\/resources-for-year-12-ancient-greek-studies\/three-bar-sigma\" rel=\"noopener\" target=\"_blank\">Athenian decrees<\/a> made at a time when notable figures such as Socrates and Pericles lived. The decrees have long been thought to have been written before 446\/445 BCE, although new evidence suggests a date of the 420s BCE. Although it might seem like a small difference, these decrees are fundamental to our understanding of the political history of Classical Athens.<\/p>\n<p data-block-key=\"yx8ds\">Our training dataset contains the earlier figure of 446\/445 BCE. To test Ithaca\u2019s predictions, we retrained it on a dataset that did not contain the dated inscriptions and then submitted these held-out texts for analysis. Remarkably, Ithaca\u2019s average predicted date for the decrees is 421 BCE, aligning with the most recent dating breakthroughs and showing how machine learning can contribute to debates around one of the most significant moments in Greek history.<\/p>\n<\/div>\n<figure class=\"single-media single-media--inline\"><figcaption class=\"single-media__caption\">\n<p data-block-key=\"mrbbi\">Figure 5. Ithaca&#8217;s predictions vs Packard Humanities Institute (PHI) dataset&#8217;s ground-truths compared to recent historical re-evaluations. PHI labels are on average 27 years off the re-evaluations, while Ithaca\u2019s predictions are on average only 5 years off the newly proposed ground-truths.<\/p>\n<\/figcaption><\/figure>\n<div class=\"gdm-rich-text rich-text\">\n<p data-block-key=\"vb1n4\">We believe this is just the start for tools like Ithaca and the potential for collaboration between machine learning and the humanities. Ancient Greece plays an instrumental role in our understanding of the Mediterranean world, but it\u2019s still only one part of a vast global picture of civilisations. To that end, we are currently working on versions of Ithaca trained on other ancient languages and historians can already use their datasets in the current architecture to study other ancient writing systems, from <a href=\"https:\/\/en.wikipedia.org\/wiki\/Akkadian_language\" rel=\"noopener\" target=\"_blank\">Akkadian<\/a> to <a href=\"https:\/\/en.wikipedia.org\/wiki\/Demotic_(Egyptian)\" rel=\"noopener\" target=\"_blank\">Demotic<\/a> and <a href=\"https:\/\/en.wikipedia.org\/wiki\/Hebrew_language\" rel=\"noopener\" target=\"_blank\">Hebrew<\/a> to <a href=\"https:\/\/en.wikipedia.org\/wiki\/Mayan_languages\" rel=\"noopener\" target=\"_blank\">Mayan<\/a>. We hope that models like Ithaca can unlock the cooperative potential between AI and the humanities, transformationally impacting the way we study and write about some of the most significant periods in human history.<\/p>\n<\/div>\n<aside class=\"notes\">\n<div class=\"glue-page\">\n<div class=\"gdm-rich-text notes__inner\">\n<h2 data-block-key=\"9myu6\">Notes<\/h2>\n<p data-block-key=\"ox2pm\">This work was done by a team including contributions from Yannis Assael, Thea Sommerschield, Brendan Shillingford, Mahyar Bordbar, John Pavlopoulos, Marita Chatzipanagiotou, Ion Androutsopoulos, Jonathan Prag, and Nando de Freitas. The Ithaca web interface was developed by Justin Grayston, Benjamin Maynard, and Ricardo Cardenas from Google Cloud.<\/p>\n<\/p><\/div>\n<\/p><\/div>\n<\/aside><\/div>\n<p>[ad_2]<br \/>\n<br \/><a href=\"https:\/\/deepmind.google\/discover\/blog\/predicting-the-past-with-ithaca\/\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>[ad_1] Research Published 9 March 2022 Authors Yannis Assael, Thea Sommerschield *, Brendan Shillingford, Nando de Freitas (*external<\/p>\n","protected":false},"author":2,"featured_media":854,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21],"tags":[],"class_list":["post-853","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-deepmind-ai"],"_links":{"self":[{"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/posts\/853","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/comments?post=853"}],"version-history":[{"count":1,"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/posts\/853\/revisions"}],"predecessor-version":[{"id":2632,"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/posts\/853\/revisions\/2632"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/media\/854"}],"wp:attachment":[{"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/media?parent=853"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/categories?post=853"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/todaysainews.com\/index.php\/wp-json\/wp\/v2\/tags?post=853"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}