IEEE Toronto Section


Operational-Log Analysis for Big Data Systems: Challenges and Solutions

Friday November 18, 2016 at 12:00 p.m. Dr. Andriy Miranskyy, Assistant Professor at the Department of Computer Science, Ryerson University, will be presenting “Operational-Log Analysis for Big Data Systems: Challenges and Solutions”.

Speaker: Dr. Andriy Miranskyy
Assistant Professor, Department of Computer Science, Ryerson University

Day & Time: Friday, November 18, 2016
12:00 p.m. – 1:00 p.m.

Location: George Vari Centre for Computing and Engineering
Ryerson University
Room: ENG 288
245 Church Street, Toronto, Ontario M5B 2K3
Map – – Look for ENG

Registration: Registration is free, but space is limited. Please register via this link:

Organizers: IEEE Toronto Systems Chapter, Alexei Botchkarev
IEEE Toronto WIE, Magnetics, Measurement/Instrumentation-Robotics and Computer Science Department of Ryerson University
IEEE Toronto WIE Chair: Maryam Davoudpour

Abstract: Big data systems (BDSs) are complex, consisting of multiple interacting hardware software components, such as distributed compute nodes, networking, databases, middleware, business intelligence layer, and high availability infrastructure. Any of these components can fail. Finding the failures’ root causes is extremely laborious. Analysis of BDS-generated logs can speed up this process. The logs can also help improve testing processes, detect security breaches, customize operational profiles, and aid with any other tasks requiring runtime-data analysis.

However, practical challenges hamper log analysis tools’ adoption. The logs emitted by a BDS can be thought of as big data themselves. When working with large logs, practitioners face seven main issues: scarce storage, unscalable log analysis, inaccurate capture and replay of logs, inadequate log-processing tools, incorrect log classification, a variety of log formats, and inadequate privacy of sensitive data. This talk describes the challenges and practical solutions faced while building and institutionalizing dynamic analysis tools in the industry.

Biography: Andriy Miranskyy is an assistant professor at the Department of Computer Science, Ryerson University. His research interests are in the area of mitigating risk in software engineering, focusing on software quality assurance, program comprehension, software requirements, project risk management, Big Data, and Green IT. Andriy received his Ph.D. in Applied Mathematics at the University of Western Ontario. He has 17 years of software engineering experience in information management and pharmaceutical industries. Prior to joining Ryerson, Andriy worked as a software engineer in the IBM Information Management division at the IBM Toronto Software Laboratory; currently, he is the Faculty Fellow of the IBM Centre for Advanced Studies. He has served as Guest Editor for a special edition of IEEE Software as well as organizer, committee member, and reviewer for several software engineering workshops and conferences.

Comments are closed.