Dicta, The Center for Text Analysis is an Israeli non-profit organization focused on research and education in the field of computational linguistics and its application to the Hebrew language, including the religious literature across generations.[1]
דיקטה - המרכז לניתוח טקסטים | |
Leader | Moshe Koppel |
---|---|
Website | https://dicta.org.il/ |
The organization provides tools that utilize artificial intelligence algorithms, machine learning, natural language processing, and language models for the purpose of researching, processing, and analyzing Hebrew texts and creating Hebrew content. These tools are available for free use and open source for the benefit of the public.[2]
Services
editDicta-LM 2.0 Model
editIn 2024, the organization, together with Maf'at, the Israeli Association for Human Language Technologies, and a team of researchers from Intel, introduced a large language model (LLM) for commercial and research use under the Apache 2.0 license. This model, specifically adapted for Hebrew, can be used for various applications such as chatbots and translation tools.[3][4]
Nakdan
editThe "Nakdan" is an advanced system for the automatic Niqqud (adding diacritics) of Hebrew text, developed by Dr. Avi Shmidman, a researcher in the Department of Hebrew Literature at Bar-Ilan University and an advisor at the academy of the Hebrew Language, Elthiel Shmidman, Professor Moshe Koppel, a computer science professor, and Professor Yoav Goldberg, an expert in computer science and linguistics. Unlike other Niqqud software available on the market, Nekdan is designed to "understand human language" rather than merely holding a database of Niqqud words and attempting to match unNiqqud words with appropriate Niqqud ones. Therefore, Nekdan usually chooses the correct Niqqud for a word. The system uses modern neural network models along with extensive linguistic knowledge and manually collected resources to achieve high accuracy in placing diacritics. The system supports modern, rabbinic, and poetic Hebrew and includes features for manual correction, making it useful for creating academic editions of historical texts. The system is freely accessible on the internet for public use.[5]
Advanced Search Engines in Jewish Sources
editDicta provides a variety of advanced search options for searching words and phrases in the Bible, Talmud, and other rabbinic texts. The search includes context-based search, search by similar words, ignoring spelling and inflection differences, optical character recognition, automatic correction of recognition errors based on context, and more.[citation needed]
References
edit- ^ "דיקטה - המרכז לניתוח טקסטים (ע"ר) - מסמכים ודיווחים". www.guidestar.org.il. Retrieved 2024-06-02.
- ^ דור, אופיר. "ראשי פורום קהלת פיתחו צ'אטבוט AI בעברית — בשיתוף עם משרד הביטחון". TheMarker. Retrieved 2024-06-02.
- ^ "הכירו את Dicta-LM 2.0 – מודל שפה גדול, חינמי ופתוח בעברית". www.gadgety.co.il (in Hebrew). 2024-05-03. Retrieved 2024-06-02.
- ^ "DICTA". dicta.org.il. Retrieved 2024-06-02.
- ^ Shmidman, Avi; Shmidman, Shaltiel; Koppel, Moshe; Goldberg, Yoav (2020). "Nakdan: Professional Hebrew Diacritizer". Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations. Association for Computational Linguistics. pp. 197–203. arXiv:2005.03312. doi:10.18653/v1/2020.acl-demos.23.