Optical Character Recognition (OCR) is still working on making a multilingual model that incorporates the Hungarian language. We introduce a hybrid Hungarian and English model, one of the biggest challenges is to recognize handwritten text. We are going to investigate a set of models in this research, such as TrOCR large-handwritten, leveraging PULI-BERT, and Roberta-base with Diet models. The digitization of documents, and the preservation of cultural heritage specifically, has long been a research problem related to text recognition. We use an extensive text on the recognition approach using pre-trained visual and language transformer models. We pre-train the TrOCR proposed by Microsoft researchers for both large and base models at the first phase and then fine-tune them on human data at the second stage. Then, leverage new pre-trained transformers models such as Roberta-base, and PULI-BERT, as decoders and Diet, Vit, and Beit as encoder models at the pre-training phase on generated synthetic data and then fine-tune them on a small amount of human-annotated data provided by (DH-Lab) researchers with augmentation and without augmentation. Developed using tiny-scale Synthetic data of around three-million-line text open-source corpus, and subsequently refined using tiny person-labeled datasets. Experiments showed that the best CER is 3.681 in the TrOCR large handwritten, and the best WER is 16.091 by leveraging the PULI-BERT with the Deit model. These fine-tuned models outperform the currently existing state-of-the-art TrOCR models on historical Hungarian handwriting, according to the benchmark results on the János Arany dataset.
28 July 2026 in Modeling Earth Systems and Environment
The identification of Arabic cyberbullying is generally perceived as a closed-set categorization challenge, but moderation tools need to address cases that are ambiguous, cases involving domain change in situations when review priorities are not equal. Current research introduces a selective moderation approach which can produce only either a decision about cyberbullying or refer the case to human reviewers with an optional high-priority triage flag of abusive post. As a main experiment employs a public Arabic cyberbullying corpus that was transformed into 13230 logical records and subsequently reduced to 12961 unique normalized texts after deleting 269 duplicate records (6739 cyberbullying and 6222 non-cyberbullying). Word unigram/bigram and character n-grams 3–5 were organized into TF-IDF representation, concatenated, and classified using the class-balanced LinearSVC. The results of five-fold stratified cross-validation show F1=0.9914±0.0013, macro-F1=0.9911±0.0014 and ROC-AUC=0.9996±0.0001 (mean±SD). Eventually, there was an uncertainty reject option that forwarded all cases where there was no high confidence to human agents. The deferral of 5% of the cases leads to capturing 85.7% of the errors made in non-deferral and improves the retained case’s F1 to 0.9987; a deferral of 10% of the cases captures 94.6% of the errors made and results in a retained-case F1 of 0.9995. Additionally, two audits are used to avoid inaccurate interpretations of the within-corpus score. The first involves training the cyber-bullying corpus and testing on 4,000-comment offensive language dataset of MPOLD which reduces the F1 score to 0.3882 (ROC-AUC = 0.7318). The second audit uses a different subtype proxy of hate speech from the MPOLD text allowing to obtain F1= 0.5771 and ROC-AUC = 0.7996 while addressing offensive items. Thus, it provides evidence of a necessity of human prioritization instead of autonomous risk making decisions.
Optical Character Recognition (OCR) is still working on making a multilingual model that incorporates the Hungarian language. We introduce a hybrid Hungarian and English model, one of the biggest challenges is to recognize handwritten text. We are going to investigate a set of models in this research, such as TrOCR large-handwritten, leveraging PULI-BERT, and Roberta-base with Diet models. The digitization of documents, and the preservation of cultural heritage specifically, has long been a research problem related to text recognition. We use an extensive text on the recognition approach using pre-trained visual and language transformer models. We pre-train the TrOCR proposed by Microsoft researchers for both large and base models at the first phase and then fine-tune them on human data at the second stage. Then, leverage new pre-trained transformers models such as Roberta-base, and PULI-BERT, as decoders and Diet, Vit, and Beit as encoder models at the pre-training phase on generated synthetic data and then fine-tune them on a small amount of human-annotated data provided by (DH-Lab) researchers with augmentation and without augmentation. Developed using tiny-scale Synthetic data of around three-million-line text open-source corpus, and subsequently refined using tiny person-labeled datasets. Experiments showed that the best CER is 3.681 in the TrOCR large handwritten, and the best WER is 16.091 by leveraging the PULI-BERT with the Deit model. These fine-tuned models outperform the currently existing state-of-the-art TrOCR models on historical Hungarian handwriting, according to the benchmark results on the János Arany dataset.
Optical Character Recognition (OCR) is still working on making a multilingual model that incorporates the Hungarian language. We introduce a hybrid Hungarian and English model, one of the biggest challenges is to recognize handwritten text. We are going to investigate a set of models in this research, such as TrOCR large-handwritten, leveraging PULI-BERT, and Roberta-base with Diet models. The digitization of documents, and the preservation of cultural heritage specifically, has long been a research problem related to text recognition. We use an extensive text on the recognition approach using pre-trained visual and language transformer models. We pre-train the TrOCR proposed by Microsoft researchers for both large and base models at the first phase and then fine-tune them on human data at the second stage. Then, leverage new pre-trained transformers models such as Roberta-base, and PULI-BERT, as decoders and Diet, Vit, and Beit as encoder models at the pre-training phase on generated synthetic data and then fine-tune them on a small amount of human-annotated data provided by (DH-Lab) researchers with augmentation and without augmentation. Developed using tiny-scale Synthetic data of around three-million-line text open-source corpus, and subsequently refined using tiny person-labeled datasets.
Background The high variability of workloads makes it very difficult for cloud datacenters to efficiently schedule their tasks and resource allocation. The correct forecasting of future resource utilization allows us to proactively scale and implement more sophisticated scheduling policies, which eventually results in has potential to improve resource utilization and fewer failures. Methods Leveraging only data that is exposed to the scheduler at task dispatch times, this research assesses four supervised learning approaches for estimation of CPU consumption on the Google Cluster Data v3 trace: Linear Regression, Support Vector Regression, Random Forest, and a Neural Network. Result The randomized forest version gave the optimum regression performances on a held-out test set (MAE ≈ 0.00233, RMSE ≈ 0.00589, R 2 ≈ 0.895), while an ordinary hybrid composition of the two best systems performed similarly. Estimating if a task’s real CPU consumption surpasses a train-set-derived high utilization threshold which was achieved up to 0.921 accuracy and ≈ 0.844 best F1, chosen via a detailed threshold sweeping as opposed to an individual set cutoff. Conclusions This approach are evaluated using RMSE, MAE, and R 2 for held-out on test set, while the 2nd threshold-based analysis is utilized to appraise the recognition of high-CPU tasks. These results underscore the potential of data driven approach definitely machine and deep learning-based CPU demand predictions as valuable tools for cloud schedulers, improving resource management, and reducing operational costs. Also discuss the feasibility of deploying the proposed solution on distributed platforms such as Spark and Google Cloud and outline future research directions to integrate predictive models with real-time cloud resource management.