Paul Watters

Prof. Dr. Paul Watters

PPDP & Associate Professor, Macquarie University, Sydney, Australia
orcid

Research Focus & Metrics

Academic Career Length

30Years (1997-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 July 2020 in Journal of Big Data
Verified
Journal Article
Open access
PDF file
Iqbal H. SarkerIqbal H. Sarker
Iqbal H. Sarker
A. S. M. KayesA. S. M. Kayes
A. S. M. Kayes
SBShahriar Badsha
Shahriar Badsha
HAHamed Alqahtani
Hamed Alqahtani
Paul WattersPaul Watters
Paul Watters
ANAlex Ng
Alex Ng
In a computing context, cybersecurity is undergoing massive shifts in technology and its operations in recent days, and data science is driving the change. Extractingsecurity incident patternsor insights from cybersecurity data and building correspondingdata-driven model, is the key to make a security system automated and intelligent. To understand and analyze the actual phenomena with data, various scientific methods, machine learning techniques, processes, and systems are used, which is commonly known as data science. In this paper, we focus and briefly discuss oncybersecurity data science, where the data is being gathered from relevant cybersecurity sources, and the analytics complement thelatest data-driven patternsfor providing more effective security solutions. The concept of cybersecurity data science allows making the computing process more actionable and intelligent as compared to traditional ones in the domain of cybersecurity. We then discuss and summarize a number of associatedresearch issues and future directions. Furthermore, we provide amachine learningbasedmulti-layered frameworkfor the purpose of cybersecurity modeling. Overall, our goal is not only to discuss cybersecurity data science and relevant methods but also to focus the applicability towards data-driven intelligent decision making for protecting the systems from cyber-attacks.

1 July 2019 in Journal of Big Data
Verified
Journal Article
Open access
PDF file
Iqbal H. SarkerIqbal H. Sarker
Iqbal H. Sarker
A. S. M. KayesA. S. M. Kayes
A. S. M. Kayes
Paul WattersPaul Watters
Paul Watters
Due to the increasing popularity of recent advanced features and context-awareness in smart mobile phones, the contextual data relevant to users’ diverse activities with their phones are recorded through the device logs. Modeling and predicting individual’s smartphone usage based on contexts, such as temporal, spatial, or social information, can be used to build various context-aware personalized systems. In order to intelligently assist them, a machine learning classifier based usage prediction model for individual users’ is the key. Thus, we aim to analyze the effectiveness of various machine learning classification models for predicting personalized usage utilizing individual’s phone log data. In our context-aware analysis, we first employ ten classic and well-known machine learning classification techniques, such as ZeroR, Naive Bayes, Decision Tree, Random Forest, Support Vector Machine, K-Nearest Neighbors, Adaptive Boosting, Repeated Incremental Pruning to Produce Error Reduction, Ripple Down Rule Learner, and Logistic Regression classifiers. We also present the empirical evaluations of Artificial Neural Network based classification model, which is frequently used in deep learning and make comparative analysis in our context-aware study. The effectiveness of these classifier based context-aware models is examined by conducting a range of experiments on the real mobile phone datasets collected from individual users. The overall experimental results and discussions can help both the researchers and applications developers to design and build intelligent context-aware systems for smartphone users.

15 November 2019 in IEEE Access
Verified
Journal Article
Open access
Jabed ChowdhuryJabed Chowdhury
Jabed Chowdhury
MFMd Sadek Ferdous
Md Sadek Ferdous
KBKamanashis Biswas
Kamanashis Biswas
Niaz ChowdhuryNiaz Chowdhury
Niaz Chowdhury
A. S. M. KayesA. S. M. Kayes
A. S. M. Kayes
Paul WattersPaul Watters
Paul Watters
Distributed Ledger Technology (DLT) has emerged as one of the most disruptive technologies in the last decade. It promises to change the way people do their business, track their products, and manage their personal data. Though the concept of DLT was first implemented in 2009 as Bitcoin, it has gained significant attention only in the past few years. During this time, different DLT enthusiasts and commercial companies have proposed and developed several DLT platforms. These platforms are usually categorized as public vs private, general purpose vs application specific and so on. As a growing number of people are interested to build DLT applications, it is important to understand their underlying architecture and capabilities in order to determine which DLT platform should be leveraged for a specific DLT application. In addition, the platforms need to be evaluated and critically analyzed to assess their applicability, resiliency and sustainability in the long run. In this paper, we have surveyed several leading DLT platforms and evaluated their capabilities based on a number of quantitative and qualitative criteria. The comparative analysis presented in this paper will help the DLT developers and architects to choose the best platform as per their requirement(s).

8 October 2021 in ACM Computing Surveys
Verified
Journal Article
Open access
TMTimothy Mcintosh
Timothy Mcintosh
A. S. M. KayesA. S. M. Kayes
A. S. M. Kayes
Yi-Ping Phoebe ChenYi-Ping Phoebe Chen
Yi-Ping Phoebe Chen
ANAlex Ng
Alex Ng
Paul WattersPaul Watters
Paul Watters
Although ransomware has been around since the early days of personal computers, its sophistication and aggression have increased substantially over the years. Ransomware, as a type of malware to extort ransom payments from victims, has evolved to deliver payloads in different attack vectors and on multiple platforms, and creating repeated disruptions and financial loss to many victims. Many studies have performed ransomware analysis and/or presented detection, defense, or prevention techniques for ransomware. However, because the ransomware landscape has evolved aggressively, many of those studies have become less relevant or even outdated. Previous surveys on anti-ransomware studies have compared the methods and results of the studies they surveyed, but none of those surveys has attempted to critique on the internal or external validity of those studies. In this survey, we first examined the up-to-date concept of ransomware, and listed the inadequacies in current ransomware research. We then proposed a set of unified metrics to evaluate published studies on ransomware mitigation, and applied the metrics to 118 such studies to comprehensively compare and contrast their pros and cons, with the attempt to evaluate their relative strengths and weaknesses. Finally, we forecast the future trends of ransomware evolution, and propose future research directions.

13 May 2025 in IEEE Transactions on Artificial Intelligence
Verified
Journal Article
Closed access
TMTimothy Mcintosh
Timothy Mcintosh
TSTeo Susnjak
Teo Susnjak
Nalin Asanka Gamagedara ArachchilageNalin Asanka Gamagedara Arachchilage
Nalin Asanka Gamagedara Arachchilage
Tong LiuTong Liu
Tong Liu
Dan XuDan Xu
Dan Xu
Malka HalgamugeMalka Halgamuge
Malka Halgamuge
The rapid rise in popularity of Large Language Models (LLMs) with emerging capabilities has spurred public curiosity to evaluate and compare different LLMs, leading many researchers to propose their own LLM benchmarks. Noticing preliminary inadequacies in those benchmarks, we embarked on a study to critically assess 23 state-of-the-art LLM benchmarks, using our novel unified evaluation framework through the lenses of people, process, and technology, under the pillars of benchmark functionality and integrity. Our research uncovered significant limitations, including biases, difficulties in measuring genuine reasoning, adaptability, implementation inconsistencies, prompt engineering complexity, evaluator diversity, and the overlooking of cultural and ideological norms in one comprehensive assessment. Our discussions emphasized the urgent need for standardized methodologies, regulatory certainties, and ethical guidelines in light of Artificial Intelligence (AI) advancements, including advocating for an evolution from static benchmarks to dynamic behavioral profiling to accurately capture LLMs’ complex behaviors and potential risks. Our study highlighted the necessity for a paradigm shift in LLM evaluation methodologies, underlining the importance of collaborative efforts for the development of universally accepted benchmarks and the enhancement of AI systems’ integration into society.

15 November 2023 in IEEE Transactions on Artificial Intelligence
Verified
Journal Article
Closed access
TMTimothy Mcintosh
Timothy Mcintosh
Tong LiuTong Liu
Tong Liu
TSTeo Susnjak
Teo Susnjak
Paul WattersPaul Watters
Paul Watters
ANAlex Ng
Alex Ng
Malka HalgamugeMalka Halgamuge
Malka Halgamuge
The Generative Pre-trained Transformer (GPT) models, renowned for generating human-like text, occasionally produce “hallucinations” - outputs that diverge from human expectations. Current mitigation strategies for these GPT hallucinations largely rely on algorithmic automation, thereby overlooking the complexities of human judgment and cultural influence, particularly in fact interpretation. Addressing this issue, we have introduced a Culturally Sensitive Test that integrates language subjectivity, cultural nuances, and GPT idiosyncrasies. We have applied this test to five GPT models—OpenAI’s ChatGPT-3.5 and ChatGPT-4, Google’s Bard, Perplexity AI and TruthGPT - evaluating their responses to 70 questions across seven categories designed to provoke hallucinations. The evaluated models demonstrated varying performance, with controversial topics, those lacking clear scientific consensus and the brain teasers proving more susceptible to GPT hallucinations. Our study has paved the way for a nuanced assessment of GPT hallucinations.