Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: The amount of medical and clinical-related information on the Web is increasing. Among the various types of information on the Web, social media-based data obtained directly from people are particularly valuable and garnering much attention. To encourage medical natural language processing research exploiting social media data, the NTCIR-13 MedWeb (Medical Natural Language Processing for Web Document) provides pseudo-Twitter messages in a cross-language and multi-label corpus, covering three languages (Japanese, English, and Chinese), and annotated with eight symptom labels (e.g., cold, fever, flu, and so on). Then, participants classify each tweet into one of two categories: those containing a patient’s symptom, and those that do not. Objective: We aim to present the results of groups participated in the Japanese subtask, the English subtask, and the Chinese subtask along with discussions, in order to clarify the issues that need to be resolved in the field of medical natural language processing. Methods: The performance of participant systems is assessed using the exact match accuracy, F-measure based on precision and recall, and Hamming loss. Results: In all, eight groups (19 systems) participated in the Japanese subtask, four groups (12 systems) participated in the English subtask, and two groups (six systems) participated in the Chinese subtask. The best system achieved .880 in exact match accuracy, .920 in F-measure, and .019 in Hamming loss. Conclusions: This paper presented and discussed the performance of systems participated in the NTCIR-13 MedWeb task. Because the MedWeb task settings can be formalized as the factualization of text, the achievement of this task could be applied directly to practical clinical applications.