{"id":21632,"date":"2024-10-04T14:05:59","date_gmt":"2024-10-04T12:05:59","guid":{"rendered":"https:\/\/dhd-blog.org\/?p=21632"},"modified":"2024-10-04T14:07:41","modified_gmt":"2024-10-04T12:07:41","slug":"call-for-abstracts-llm-fails-failed-experiments-with-generative-ai-and-what-we-can-learn-from-them","status":"publish","type":"post","link":"https:\/\/dhd-blog.org\/?p=21632","title":{"rendered":"Call for Abstracts: LLM fails \u2013 Failed experiments with Generative AI and what we can learn from them"},"content":{"rendered":"\n<div id=\"meta-origin\" data-coolorigin=\"https%3A%2F%2Fcloud-office.ids-mannheim.de%2Fcool%2Fclipboard%3FWOPISrc%3Dhttps%253A%252F%252Fcloud.ids-mannheim.de%252Findex.php%252Fapps%252Frichdocuments%252Fwopi%252Ffiles%252F11221629_oc61934p89wd%26ServerId%3D5fcc0bd8%26ViewId%3D9%26Tag%3D77ace664fad82486\">\n<p align=\"justify\"><strong><em><span style=\"font-family: DejaVu Serif, serif\"><span style=\"font-size: medium\">**automatic English translation below**<\/span><\/span><\/em><\/strong><\/p>\n<p align=\"justify\"><strong>Workshop am 8. und 9. April 2025 im Leibniz-Institut f\u00fcr Deutsche Sprache, Mannheim<br \/><\/strong><\/p>\n<p align=\"justify\">Visit our <a href=\"https:\/\/www.ids-mannheim.de\/home\/lexiktagungen\/llm-fails\"><strong>Workshop-Website <\/strong><\/a>\u00a0to stay up-to-date.<\/p>\n<p><em>Organisation: Annelen Brunner, Christian Lang, Ngoc Duyen Tanja Tu <br \/><\/em><\/p>\n<p>Gescheiterte Experimente finden f\u00fcr gew\u00f6hnlich keinen Platz im wissenschaftlichen Diskurs, sie werden verworfen und nicht publiziert. Wir glauben, dass dadurch potenzieller Erkenntnisgewinn verloren geht. Schlie\u00dflich erm\u00f6glicht eine systematische Reflexion \u00fcber die Gr\u00fcnde des Scheiterns, angewendete Methoden zu hinterfragen und\/oder zu verbessern. Zudem kann bei der\u00a0Wiederholung zuvor gescheiterter Experimente explizit Fortschritt ermittelt werden, wenn diese dann gelingen. Die Diskussion und Dokumentation von Fehlschl\u00e4gen schafft somit aus Perspektive der Methodenreflexion einen Mehrwert f\u00fcr die wissenschaftliche Gemeinschaft. Dies gilt umso mehr in einem Bereich wie der Forschung zu und mit Generativer K\u00fcnstlicher Intelligenz, die nicht auf eine jahrzehntelange Tradition zur\u00fcckblicken kann und in dem Best Practices erst ausgehandelt werden.<\/p>\n<p>In diesem Workshop stehen linguistische und NLP-Experimente mit Generativer K\u00fcnstlicher Intelligenz im Fokus, die nicht die gew\u00fcnschten Ergebnisse gebracht haben, beispielsweise, aber nicht beschr\u00e4nkt auf:<\/p>\n<ul>\n<li>Einsatz einer Generativer KI als Named-Entity-Recognizer<\/li>\n<li>Einsatz einer Generativer KI zur automatischen Transkription von gesprochenen Sprachdaten<\/li>\n<li>Einsatz einer Generativer KI zur Erstellung von W\u00f6rterbuchartikeln<\/li>\n<li>Einsatz einer Generativen KI zur Detektion von Sprachwandelph\u00e4nomenen<\/li>\n<\/ul>\n<p>Im Beitrag sollte klar werden, inwiefern dieses Scheitern zum Erkenntnisgewinn bez\u00fcglich der Arbeit mit Generativer KI beitragen kann.<\/p>\n<p>Unver\u00f6ffentlichte Beitragsvorschl\u00e4ge k\u00f6nnen bis zum <strong>02.12.2024<\/strong> in Form eines Abstracts (500-750 W\u00f6rter) in deutscher oder in englischer Sprache anonymisiert an folgende Mailadresse gesendet werden:<\/p>\n<p><a>llmfails(at)ids-mannheim.de<\/a><\/p>\n<p>\u00dcber die Annahme der Beitr\u00e4ge entscheidet das Organisationsteam bis zum <strong>16.12.2025<\/strong>. Bei Annahme des Beitrags wird die Ausarbeitung zu einem short paper (4-6 Seiten ohne Referenzen) auf Englisch bis zum <strong>15.02.2025<\/strong> erbeten. Es ist geplant, die angenommenen short paper zu ver\u00f6ffentlichen.<\/p>\n<p>Der Workshop findet vom <strong>8.-9.4.2025<\/strong> (Lunch-to-Lunch) am Leibniz-Institut f\u00fcr Deutsche Sprache in Mannheim statt. Die 20-min\u00fctigen Vortr\u00e4ge k\u00f6nnen auf Deutsch oder Englisch gehalten werden.<\/p>\n<h2><strong>Call for Abstracts (English)<\/strong><\/h2>\n<p>Failed experiments typically have no place in scientific discourse; they are discarded and not published. We believe this leads to a loss of potential knowledge. After all, a systematic reflection on the reasons for failure allows for the questioning and\/or improvement of methods used. Furthermore, when previously failed experiments are repeated and succeed, explicit progress can be determined. Thus, the discussion and documentation of failures creates added value for the scientific community from the perspective of methodological reflection. This is even more relevant in a field like research into and with Generative Artificial Intelligence (AI), which cannot look back on decades of tradition and where best practices are still being negotiated.<\/p>\n<p>This workshop focuses on linguistic and NLP experiments with Generative AI that did not yield the desired results, such as but not limited to:<\/p>\n<ul>\n<li>Using Generative AI as a Named-Entity Recognizer<\/li>\n<li>Using Generative AI for automatic transcription of spoken language data<\/li>\n<li>Using Generative AI for the creation of dictionary entries<\/li>\n<li>Using Generative AI for the detection of language change phenomena<\/li>\n<\/ul>\n<p>The contribution should clarify how this failure can contribute to knowledge gain regarding the work with Generative AI.<\/p>\n<p>Unpublished proposals can be submitted anonymously as an abstract (500-750 words) in either German or English to the following email address by <strong>December 2, 2024<\/strong>:<\/p>\n<p><u><a>llmfails(at)ids-mannheim.de<\/a><\/u><\/p>\n<p>The organization team will decide on the acceptance of contributions by <strong>December 16, 2025<\/strong>. If a contribution is accepted, a short paper (4-6 pages without references) in English will be requested by <strong>February 15, 2025<\/strong>. The accepted short papers are planned to be published.<\/p>\n<p>The workshop will take place from <strong>April 8-9, 2025<\/strong> (Lunch-to-Lunch) at the Leibniz Institute for the German Language in Mannheim. The 20-minutes presentations can be given in either German or English.<\/p>\n<h2><strong>Important dates<\/strong><strong>:<\/strong><\/h2>\n<p><strong>Deadline Abstract<\/strong>: December 2, 2024<\/p>\n<p><strong>Notification<\/strong>: December 16, 2025<\/p>\n<p><strong>Deadline short paper<\/strong>: February 15, 2025<\/p>\n<p><strong>Workshop<\/strong>: April 8-9, 2025 (Lunch-to-Lunch) at the Leibniz Institute for the German Language, Mannheim<\/p>\n<\/div>\n\n\n\n<figure class=\"wp-block-image size-full\"><a href=\"https:\/\/dhd-blog.org\/app\/uploads\/2024\/10\/llama_cartoon_updated_mouth.webp\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/dhd-blog.org\/app\/uploads\/2024\/10\/llama_cartoon_updated_mouth.webp\" alt=\"\" class=\"wp-image-21635\" srcset=\"https:\/\/dhd-blog.org\/app\/uploads\/2024\/10\/llama_cartoon_updated_mouth.webp 1024w, https:\/\/dhd-blog.org\/app\/uploads\/2024\/10\/llama_cartoon_updated_mouth-300x300.webp 300w, https:\/\/dhd-blog.org\/app\/uploads\/2024\/10\/llama_cartoon_updated_mouth-150x150.webp 150w, https:\/\/dhd-blog.org\/app\/uploads\/2024\/10\/llama_cartoon_updated_mouth-768x768.webp 768w, https:\/\/dhd-blog.org\/app\/uploads\/2024\/10\/llama_cartoon_updated_mouth-50x50.webp 50w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/a><\/figure>\n\n\n\n<p><em>generated with GPT-4o<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>**automatic English translation below** Workshop am 8. und 9. April 2025 im Leibniz-Institut f\u00fcr Deutsche Sprache, Mannheim Visit our Workshop-Website \u00a0to stay up-to-date. Organisation: Annelen Brunner, Christian Lang, Ngoc Duyen Tanja Tu Gescheiterte Experimente finden f\u00fcr gew\u00f6hnlich keinen Platz im wissenschaftlichen Diskurs, sie werden verworfen und nicht publiziert. Wir glauben, dass dadurch potenzieller Erkenntnisgewinn verloren [&hellip;]<\/p>\n","protected":false},"author":371,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[159,1736,644,409],"class_list":["post-21632","post","type-post","status-publish","format-standard","hentry","category-allgemein","tag-call-for-papers","tag-large-language-models","tag-linguistik","tag-nlp"],"_links":{"self":[{"href":"https:\/\/dhd-blog.org\/index.php?rest_route=\/wp\/v2\/posts\/21632","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dhd-blog.org\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dhd-blog.org\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dhd-blog.org\/index.php?rest_route=\/wp\/v2\/users\/371"}],"replies":[{"embeddable":true,"href":"https:\/\/dhd-blog.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=21632"}],"version-history":[{"count":20,"href":"https:\/\/dhd-blog.org\/index.php?rest_route=\/wp\/v2\/posts\/21632\/revisions"}],"predecessor-version":[{"id":21653,"href":"https:\/\/dhd-blog.org\/index.php?rest_route=\/wp\/v2\/posts\/21632\/revisions\/21653"}],"wp:attachment":[{"href":"https:\/\/dhd-blog.org\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=21632"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dhd-blog.org\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=21632"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dhd-blog.org\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=21632"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}