April 3, 2020 The Federal service for healthcare supervision of the Russian Federation (Roszdravnadzor) registered CDSS Webiomed as a medical device. Webiomed became the first software product with artificial intelligence that passed technical and clinical tests and received the permission for use in medicine in the Russian Federation. The main focus of "Webiomed" is disease risk management.
Chronic non-communicable diseases (NCDS) are the leading cause of morbidity and mortality in all countries of the world. They place the main burden on national health systems. The cardiovascular diseases( CVD) the largest part in the structure of NCDS. About 850 thousand people die annually in Russia. It is every 3rd death.
There are implemented a set of preventive measures against NCDS in Russia, including conducting annual medical examination, provision of a standardized set of surveys and inspections specialists, early detection of NCD risk factors. During screening there are some problems that decline the final result: obtaining and accounting for the completeness of medical data requires a lot of time, the accuracy of the applied risk assessment methods is low and their correct interpretation can be difficult. Moreover, medical appointments are often overloaded which makes it difficult to fully and correctly interpret complete and detailed medical information. As a result, the full risk stratification of the patient is not carried out and the available medical data is not used for the prevention of diseases. So,the health care system begins to deal with the patient only when the disease has already manifested itself, which often makes the prognosis heavier and requires high treatment costs.
Russian clinical decision support system (CDSS) Webiomed is a predictive analytics and risk management software for patients. It is the product that will help bring the effectiveness of disease prevention and diagnosis to a new level. The system is trained to analyze various medical data of the patient, identify risk factors and suspicions of diseases, formation of forecasts based on them, containing a comprehensive assessment of the probability of developing various diseases and death of the patient from them. It offers personal recommendations for doctosr and patients . The system is based on its own comprehensive methodology for determination of risks of developing diseases and their complications, including implementation of machine learning models and several auxiliary algorithms based on clinical recommendations and risk assessment scales.
«We have the aim to create an effective service that can help healthcare providers and doctors automatically identify high-risk patients for predictiion of various health conditions and development of diseases in the future. Our team truly believes that the future of medicine is in application the best possible ways to prevent diseases rather than fighting their Manifesto, when sometimes there is little that can really be changed. We rely on artificial intelligence and deep machine learning technologies as a key way to succeed in this goal. For this purpose, a cool team of experts in the field of medicine, machine learning, software development and market launch was assembled,», said Alexander Gusev, project development Director.
The scientific part of the project is supervised by the General Director of "SMRC Cardiology" Ministry of health of Russia, academician of RAS, Professor,PhD in Medical sience Sergey Anatolyevich Boytsov.
Scientific consultants are the leading scientists of Petrozavodsk State University. Tatiana Kuznetsova, PHD, Head of the Department of faculty therapy, Phthisiology, infectious diseases and epidemiology, advises the project on medical questions. Alexander Rogov, PHD, Professor, Head of the Department of probability theory and data analysis.
"The implementation of modern information technologies in daily work of doctors is very important today. First of all the doctors needs to communicate with patients who asked for help and а computer should be a useful assistant for him. We are already used to keeping that doctors save medical records in electronic form but developments in the field of artificial intelligence have not yet been widely introduced into our clinical practice. At the same time, we have no idea what huge opportunities opens this technology for us.
Clinical decision support system Webiomed helps doctors to assess the risk of cardiovascular disease at the early stage when it has not yet been clinically manifested, help to assess the risk of existing cardiovascular diseases, without additional research and time-consuming analysis of information. Doctor needs to ask the question "Webiomed" clicking on the one button, after that the CDSS is searching for information itself and give the result for, according to which he will already make a decision – which prevention and treatment program to assign to the patient. The very important aspect of using artificial intelligence in medicine is analytical work such as the ability to analyze the epidemiological prevalence of specific risk factors. This is important for improving efficiency of regional health care, " said Tatyana Kuznetsova, research Director of the project on medicine.
Assessing the goal of creating the system and its development, the chief freelance specialist in radiation and instrumental diagnostics, director of the Scientific and Practical Clinical Center for Diagnostics and Telemedicine Technologies of the Moscow Department of Health, professor at the Department of Radiation Diagnostics and Radiation Therapy, First Moscow State Medical University named after I.M. Sechenova »Ministry of Health of Russia, PHD, Sergey Morozov reported : “Support systems for making medical decisions are irreplaceable assistants to a doctor. In fact they are safety systems for healthcare- a kind of autopilot. CDSS are not directories that are referred to as necessary. On the contrary, they work in the background, scan medical data and attract the attention of a doctor to patients with a high risk of stroke, with signs of cancer on computed tomography, with errors in prescribing drugs. In contemporary medicine, with its huge streams of digital data, automation is indispensable and the key to ensuring timely diagnosis is in it. At the same time, conducting clinical trials of CDSS allows us to guarantee the reliability of their work and safety for use in any clinics. The development team of this system acted as a pioneer and paved the way for many manufacturers of CDSS which will make healthcare more accessible, transparent, reliable and useful for all patients. ”
Webiomed is for integration into medical information systems and other software products for healthcare management. It eliminates doctors of manually identify the necessary information in electronic medical records and provides a ready-made risks assessment of the diseases, such as the total risk of developing atherosclerosis and its complications, the risk of thromboembolic complications in heart rhythm disorders, the risk of cardiac arrest in hospitalized patients, the severity of community-acquired pneumonia, etc. Based on these assessments, the system makes recommendations for determining patient management tactics.
Webiomed uses models created by machine learning:
1. Prediction of an individual probability of CVD development based on machine learning for 10 years
2. Prediction of individual probability of death from coronary heart disease and stroke based on machine learning for 10 years
To build the model "Forecast of individual probability of developing CVD", the features used in the Framingham scale were taken. An artificial neural network was used as a machine learning method. As a result, the model estimates the probability of developing CVD cases in a patient over the next 10 years. The model provides the following parameters: accuracy: 78%, area under the ROC curve (AUC): 0.77. As a result of training, the predictive accuracy of the Webiomed model was 19 positions higher compared to the accuracy of the Framingham scale..
We collect the signs used in the most common SCORE scale which were supplemented with 2 more clinical indicators (body mass index, heart rate) to build the model "Forecast of individual probability of death from CHD and stroke". An artificial neural network was used as a machine learning method. As a result, the model estimates the probability of developing CVD cases in a patient over the next 10 years. The model provides the following parameters: accuracy: 78%, area under the ROC curve (AUC): 0.77.
During preparation for registration of the system as a medical device, technical and clinical trials were successfully completed. During technical tests, it was confirmed that the medical device Clinical Desicion Support System "Webiomed" according to technical SPECIFICATIONS 62.01.29-001-12860736-2019 " performs the stated functions in accordance with the operational documentation when used for the intended purpose provided by the manufacturer and meets the requirements of current national standards: GOST R ISO/IEC 12119-2000, GOST R ISO/IEC 9126-93, GOST R 51188-98, GOST R IEC 62304-2013, requirements for technical and operational documentation of the manufacturer.
Successful clinical trials have proven the safety and effectiveness of the Webiomed based on real medical data obtained in the Russian Federation and not used for machine learning. For this purpose experts in coooperation with the developer company created a special test method. As a result of this work, it was concluded that the principles of operation, clinical action, ergonomics and safety, as well as artificial intelligence technologies used in Webiomed, correspond to the modern level of medical devices and meet the needs of clinical specialists, harmless for patients.
After comprehensive inspections Webiomed was registered by Roszdravnadzor as a medical device in the 1st class of potential risk of use in accordance with the nomenclature classifier of medical devices approved by order No. 4n of the Ministry of health of the Russian Federation dated June 06, 2012. Webiomed safety class accordance with GOST R IEC 62304-class A. The system resieved a Registration certificate no. "RZN 2020/9958", a unique number of the registry entry 41741 in the state register of medical devices, available at htps://roszdravnadzor.ru/services/misearch.https://roszdravnadzor.ru/services/misearch
"The registration of our product "Webiomed" as a medical device is the result of systematic and well – coordinated work of entire project team and a large number of partners in pilot projects and of course doctors, who helped us in every way with advice, criticism and the desire to make a sound and useful tool for healthcare. We looked forward to this event and finally we can say with confidence that now our team has a very good reason to be proud of the excellent result. Now we are preparing to attract significant investments in order to focus our efforts on the development and promotion of Webiomed implementation projects in practical healthcare, "said Roman Novitsky, the company's Director.
Pilot implementation of the system took place in the Yamalo-Nenets Autonomous district, the Kirov region and several medical organizations in the Republic of Karelia. During this time, it was used to analyze more than 1 million electronic medical records, including a retrospective analysis of medical examination data, comparative studies of the accuracy of risk assessment by doctors and artificial intelligence and collected, analyzed feedback from doctors who asked for a "second opinion" from CDSS. Pilot projects have confirmed the practical significance of the service: the system is really able to relieve the doctor from routine analysis of medical data and more accurately identify risk factors and high-risk patients, which helps to focus the work of medical organizations on preventive personalized medicine and thus reduce the burden of cardiovascular diseases.