Home Health IT Clinical Decision Support for Genetically Guided Personalized Medicine



Clinical Decision Support for Genetically Guided Personalized Medicine

A Systematic Review
by Humanity Upgrade

Clinical Decision Support for Genetically Guided Personalized Medicine

Abstract

Objective To review the literature on clinical decision support (CDS) for genetically guided personalized medicine (GPM).

Materials and Methods MEDLINE and Embase were searched from 1990 to 2011. The manuscripts included were summarized, and notable themes and trends were identified.

Results Following a screening of 3416 articles, 38 primary research articles were identified. Focal areas of research included family history-driven CDS, cancer management, and pharmacogenomics. Nine randomized controlled trials of CDS interventions for GPM were identified, seven of which reported positive results. The majority of manuscripts were published on or after 2007, with increased recent focus on genotype-driven CDS and the integration of CDS within primary clinical information systems.

Discussion Substantial research has been conducted to date on the use of CDS to enable GPM. In a previous analysis of CDS intervention trials, the automatic provision of CDS as a part of routine clinical workflow had been identified as being critical for CDS effectiveness. There was some indication that CDS for GPM could potentially be effective without the CDS being provided automatically, but we did not find conclusive evidence to support this hypothesis.

Conclusion To maximize the clinical benefits arising from ongoing discoveries in genetics and genomics, additional research and development is recommended for identifying how best to leverage CDS to bridge the gap between the promise and realization of GPM.

Background

Genetically guided personalized medicine (GPM) entails the delivery of individually tailored medical care that leverages information about each person’s unique genetic characteristics.1 The promise of GPM has expanded as advances in genomics have accelerated over the past several decades. This promise of GPM is that research discoveries will one day lead to medical treatments and therapies that are tailored to the individual characteristics of each patient, including clinical data, genetic test results, patient preference, and family health history (FHx). GPM has the potential to increase the efficacy, quality, and value of healthcare by providing individually optimized prevention, diagnosis, and treatment.2

As ongoing research continues to expand the GPM knowledge base, it has become increasingly important to translate this knowledge into routine healthcare practice in order to realize the promise of GPM.3 However, the effective realization of GPM remains very limited.4 While this is partly due to the need for further evidence of the clinical utility and cost effectiveness of a genetically guided approach to patient care, an important additional reason is the need for information systems that assist in the translation of knowledge from bench to bedside.5 Even without the complexity of genetics, it can often take over 15 years to translate research from bench to bedside.6 This translational bottleneck is likely to be an even more significant problem in GPM for the following reasons.

Limited genetic proficiency of clinicians

Many clinicians receive minimal training in clinical genetics. As a result, many physicians lack the confidence and understanding needed for effectively interpreting and using genetic information in their clinical practices.7

Limited availability of genetics experts

Currently, there are about 3000 board-certified genetic counselors8 and approximately 1200 medical geneticists practicing in the USA (S. R. DelBusso, American Board of Medical Genetics Administrator, October 28, 2011, personal communication). The growing utility of genetic information is putting an increasing burden on these professionals. We cannot expect these genetics experts to be readily available each time genetic information should be used to guide medical treatment. For effective, efficient, and widespread clinical use, the burden of genetic interpretation and guidance must be shared by the wider clinical community.

Breadth and growth of genetic knowledge base

There are currently over 2500 clinical genetic tests available to clinicians, encompassing a wide breadth of medical care.9 It is therefore unreasonable to expect a clinician to remember every appropriate genetic test for a particular condition in conjunction with test-specific guidelines for ordering and interpretation. Compounding this issue, the continual growth in the knowledge base and the prospect of full genome sequencing will inevitably overwhelm clinicians’ capacities to manage and leverage this information effectively for GPM unless computerized assistance is provided for interpreting and acting on this information.

Various investigators and leaders have identified health information technology as being vital to overcoming these barriers and realizing the promise of GPM.2,10 In particular, clinical decision support (CDS) has been identified as a critical enabler of GPM.11,12 CDS entails providing clinicians, patients, and other healthcare stakeholders with pertinent knowledge and person-specific information, intelligently filtered or presented at appropriate times, to enhance health and healthcare.13 CDS has the capacity to process complex, disparate data and present actionable, standardized, evidence-based recommendations in a way that is usable by a clinician in everyday practice.11 As such, CDS can help bridge the gap between the promise and realization of GPM (figure 1). Given the criticality of CDS for realizing the promise of GPM, and given the lack of a systematic review on this topic, we sought in this paper to assess the history and state of CDS for GPM through a systematic review of the literature.

Figure 1

Clinical decision support (CDS) as bridge overcoming barriers to genetically guided personalized medicine.

Clinical decision support (CDS) as bridge overcoming barriers to genetically guided personalized medicine.

Methods
Data sources and inclusion criteria

We searched MEDLINE and Embase from 1990 to 2011 using a search strategy adapted from previous systematic reviews of CDS,14 genetic health services,15 and FHx16 (see supplementary appendix, available online only, for full search strategy). The final literature search was conducted on June 1, 2012. The inclusion criteria for the review were as follows: English article; human focus; manuscript in peer-reviewed journal; and primary focus on the use of computers to deliver genetically guided, patient-specific assessments and/or recommendations to healthcare providers and/or patients to guide clinical decision-making, as further defined in Box 1.

____________________________________________________________

Box 1

Manuscript inclusion criteria

  • Definitions:

    • Healthcare provider = physician, nurse practitioner, physician assistant, registered nurse, or genetic counselor

    • Genetic factor = genotype, gene expression profile, and/or family health history

  • Universal inclusion criteria:

    • English article

    • Human focus

    • Manuscript in peer-reviewed journal

  • Additional inclusion criteria (at least one):

    • Intervention study evaluating the impact of a CDS system in an actual patient care context

      • For a comparative intervention study, CDS required to be a part of the primary intervention under evaluation

      • Excludes laboratory evaluations or simulation studies

    • Methodology article whose primary focus is on how CDS systems should be designed specifically to support clinical delivery of patient-specific assessments and/or recommendations guided by genetic factors. Includes system description articles.

____________________________________________________________

For all identified references, the authors reviewed titles, index terms, and available abstracts to determine if the articles appeared to meet all inclusion criteria. If insufficient information was available to make a confident decision at this stage, the article was included for full-text retrieval. Each full-text article was then reviewed to determine its final inclusion status.

Data abstraction

For each of the articles that met the inclusion criteria listed above, we abstracted data on the clinical application area, CDS type, genetic information used, primary users, article type, study location, CDS purpose, and notable informatics aspects. CDS type was defined as being either stand-alone CDS or integrated CDS. A stand-alone CDS system is a CDS system that exists in isolation from a primary clinical information system containing relevant patient data, such as an electronic health record (EHR) system. A stand-alone CDS system requires manual data input before a CDS result can be produced. In contrast, an integrated CDS system is integrated with a primary clinical information system such as an EHR system or a computerized provider order entry system to aggregate necessary patient-specific information automatically and to provide guidance within routine clinical workflows. Clinical application area was defined as the clinical domain targeted by the CDS intervention. Article type consisted of system description papers and evaluation studies of various types (eg, qualitative evaluation, randomized controlled trial). Genetic information used consisted of FHx, genotype, or both. Primary users were defined as the individuals who primarily entered information and received the results. Study location was the country or region where the research was conducted. CDS purpose identified the role of the CDS system within the context of clinical decision-making. A notable informatics aspect was also abstracted if a manuscript utilized a methodology that was considered to be of potential interest to an informatics audience. For intervention studies, additional details regarding the study size and study outcomes were abstracted.

Data analysis and presentation

Using the abstracted attributes, the manuscripts were grouped into logical categories, primarily according to CDS type and clinical application area. The findings from these manuscripts were summarized through tables and narrative discussion. In addition, notable themes and trends were identified and discussed. A quantitative analysis of CDS trials to identify features predictive of trial outcomes was considered.14 However, due to the limited sample size of CDS trials available, such a quantitative analysis of potential success factors was not feasible.

Results

The initial MEDLINE and Embase searches identified 3416 potentially relevant articles. During the title and abstract review, 82 articles were rejected for not being in English, 504 articles were rejected because they were not focused on humans, 34 articles were rejected for not being a peer-reviewed manuscript, and 2494 articles were rejected because the primary focus of the work was not on the use of computers to deliver genetically guided, patient-specific assessments and/or recommendations. The remaining 302 articles underwent full-text review, at which stage 37 articles were rejected for not being a peer-reviewed primary research article and 227 articles were rejected because the primary focus of the work was not on the use of computers to deliver genetically guided, patient-specific care guidance (figure 2). The final set of included manuscripts consisted of 38 primary research articles.1754 The manuscripts included were published from 1990 to 2011, with the majority of manuscripts published on or after 2007. Provided below is a summary and analysis of these earlier works, grouped primarily by CDS type and area of clinical focus.

Figure 2

Manuscript selection process. CDS, clinical decision support; GPM, genetically guided personalized medicine.

CDS systems for genetically guided cancer management

Genetically guided cancer management was the focus of 22 primary research articles summarized in tables 1–4.1737,54 These manuscripts include six manuscripts related to the Risk Assessment in Genetics (RAGs) system for providing FHx-driven CDS (table 1),1721,54 six manuscripts on other FHx-driven CDS tools for breast cancer management (table 2),2227 four manuscripts on genotype-driven CDS tools for breast cancer management (table 3),2831 and six additional manuscripts on GPM CDS tools for non-breast cancer management (table 4).3237

Table 1

CDS, clinical decision support; FHx, family health history; GP, general practitioner; GPM, genetically guided personalized medicine; GRAIDS, Genetic Risk Assessment in an Intranet and Decision Support; RAGs, Risk Assessment in Genetics; RCT, randomized controlled trial.

Summary of primary research on CDS systems for cancer-related GPM: other FHx CDS tools for breast cancer management

CDS, clinical decision support; FHx, family health history; GP, general practitioner; GPM, genetically guided personalized medicine; RCT, randomized controlled trial.

Summary of primary research on CDS systems for cancer-related GPM: genotype-driven CDS tools for breast cancer management

CDS, clinical decision support; GPM, genetically guided personalized medicine; RCT, randomized controlled trial; REACT, Risks, Events, Actions and their Consequences over Time.

Summary of primary research on CDS systems for cancer-related GPM: CDS for other cancers

CDS, clinical decision support; FHx, family health history; GPM, genetically guided personalized medicine; RCT, randomized controlled trial.

RAGs system for providing FHx-driven CDS

Some of the earliest and most comprehensive research on the use of CDS to support GPM was conducted by Emery55 (table 1), who identified that existing systems were not designed for primary care and that none provided patient management advice based on calculated risk. To address this gap, Emery developed a system known as RAGs, which helped general practitioners (GPs) in the UK collect FHx relevant to familial breast, ovarian, and colorectal cancer and provided appropriate management guidance, primarily regarding guideline-based specialist referrals.1719,54 A later extension of the RAGs system was referred to as the GRAIDS system.20,21 This body of work included several favorable evaluations of these systems,18,19,21 including a cluster randomized controlled trial (RCT) across 45 GP teams that found that GRAIDS significantly increased the proportion of patients referred appropriately to the regional genetics clinic according to evidence-based practice guidelines.21

Other FHx CDS tools for breast cancer management

Beyond the work of Emery,55 CDS research for GPM has focused heavily on breast cancer management (table 2). Risk assessment tools for breast cancer can enable personalized care according to an individual’s level of risk.22,23 An RCT conducted in the UK found that a stand-alone breast cancer CDS tool had limited impact due to lack of awareness and use by GPs.24 At the same time, a stand-alone CDS tool that calculated risks for breast cancer, heart disease, osteoporosis, and endometrial cancer was shown in an RCT to enhance the effectiveness of genetic counselors using the system.25,26 Another stand-alone CDS system that has been found to be beneficial is HughesRiskApps, which collects relevant FHx information and provides clinicians with various tools to support the management of patients. An observational implementation study of this tool in a community hospital setting found significant adoption and impact.27

Genotype-driven CDS tools for breast cancer management

Several investigators have developed CDS systems that support treatment and decision-making once mutations have been identified in the breast cancer (BRCA) genes (table 3). In the UK, Glasspool and colleagues30,31 developed a CDS tool known as REACT (Risks, Events, Actions and their Consequences over Time), which used a graphical timeline display to model real-time changes in lifetime risks as a result of risk-reduction interventions for breast cancer and ovarian cancer. In addition, several patient-directed, stand-alone CDS systems have been developed for improving risk communication and decision-making in breast cancer management based on BRCA genotype.28,29

CDS for other cancers

Besides breast cancer, other cancers have been the focus of CDS research and development (table 4). Most of this CDS research for other cancers has involved colorectal cancer, and in particular Lynch syndrome—a strongly heritable type of colorectal cancer.3234 Of note, the RAGs and GRAIDS systems described earlier supported both breast cancer and colorectal cancer management.1721,54 An additional CDS system investigated for colorectal cancer management is CRCAPRO, similar to BRCAPRO, which used FHx to identify patients at risk of hereditary colorectal cancer.33 In addition, a group in the Netherlands developed a CDS intervention to remind pathologists to order Lynch syndrome genetic testing among patients who met certain criteria, one of which was a suspicious FHx. This intervention significantly improved pathologists’ recognition of patients at risk of Lynch syndrome.34 Moreover, Dr Henry Lynch, for whom Lynch syndrome is named, developed a CDS system for supporting his hereditary cancer consulting service. This CDS system expedited clinicians’ decision-making processes and resulted in a significant reduction in time spent on cases.32

Similar to the stand-alone CDS systems for breast cancer management described earlier,28,29 stand-alone CDS tools have been shown to be useful for the management of other types of cancers, including prostate cancer37 and alcohol-related cancers.36 These studies included an RCT that showed that a patient-directed, genotype-driven CDS tool for alcohol-related cancer risk significantly reduced alcohol consumption by patients at increased genetic risk.36 These studies, as well as the previous studies on breast cancer,28,29 showed that patient-directed CDS systems can be clinically useful.

CDS for pharmacogenomics

Pharmacogenomics, the practice of tailoring drug therapy to the patient’s unique genetic characteristics, can be a complicated process; genetically guided CDS offers a solution for simplifying this process. Table 5 summarizes the six primary research articles identified on this topic.3843 These studies include a description and validation of a CDS system for genetically guided treatment of HIV infections,38 as well as an RCT that found that genotyping combined with CDS-guided therapy improved outcomes over standard of care.39 Outside of HIV therapy, other investigators focused on how CDS for pharmacogenomics could be integrated with primary clinical information systems such as computerized provider order entry systems.40,42,43 These studies evaluated considerations such as developing the underlying pharmacogenomics knowledge base,40 representation of genetic information in the EHR for supporting pharmacogenomics CDS,42 and the availability of patient data required for pharmacogenomics within the EHR.43 The lone stand-alone system for pharmacogenomics used genotype and clinical data to estimate and graphically represent a patient’s plasma warfarin concentration over time.41

Table 5

Summary of primary research on CDS systems for pharmacogenomics

CDS, clinical decision support; CTSHIV, Customized Treatment Strategies for HIV; EHR, electronic health record; RCT, randomized controlled trial.

Other CDS systems for GPM

Table 6 summarizes the 10 primary research articles that were neither cancer specific nor focused on pharmacogenomics.4453 As with CDS for cancer, there has been a substantial focus on FHx-driven CDS for other medical conditions. For example, a tool called GenInfer considered FHx and calculated inheritance risks for genetic diseases,44 and FHx-driven CDS was included as a part of the National Russian Genetic Register.45,46 Beyond these system descriptions, recent studies of FHx-driven CDS have focused on impact evaluation, with mixed results.48,49,51

Table 6

Summary of primary research on GPM CDS systems for other conditionsily health history; GPM, genetically guided personalized medicine; RCT, randomized controlled trial.

Finally, there were four primary research studies on genotype-driven CDS systems not focused on pharmacogenomics or cancer.47,50,52,53 These systems included a CDS system that retrieved genetic, radiological and clinical data from clinical information systems to provide guidance on intracranial aneurism management,52 as well as a portable medical device that integrated clinical and genetic data to provide a diagnosis for rheumatoid arthritis and multiple sclerosis.47 In addition, GeneInsight provides geneticists and other clinicians with patient-specific genetic testing reports, as well as notifications regarding updates to the presumed clinical significance of patients’ previously identified genotype.50 Finally, in a survey study, Scheuner and colleagues53 found that clinicians felt their EHR systems could do much more to meet their needs related to GPM.

Trend analysis

Publication volume on CDS for GPM generally increased over time, with a majority published since 2007 (figure 3). While all publications before 2007 focused on stand-alone CDS, 32% of articles since 2007 focused on integrated CDS (figure 4). Likewise, while 13% of manuscripts before 2007 involved the use of genotype for CDS, 61% of manuscripts since 2007 have involved the use of genotype (figure 5). As noted earlier, a major focus of the literature in this domain has been on FHx CDS, pharmacogenomics, and CDS for cancer management.

Figure 3

Publications included per year.

Figure 4

Publications focused on stand-alone versus integrated clinical decision support (CDS).

Figure 5

Publications focused on family health history (FHx)-driven versus genotype-driven clinical decision support.

____________________________________________________________
Discussion
Summary of findings

In order to learn from past research efforts and to guide future research into the use of CDS to enable GPM, we conducted a systematic review of the literature. Through a literature search spanning from 1990 to 2011, we screened 3416 manuscripts and included 38 primary research articles. A majority of these manuscripts was published from 2007 to 2011, with an increasing shift in focus from FHx CDS to genotype-driven CDS, and from stand-alone CDS to integrated CDS. There have been nine RCTs of CDS interventions for GPM, but most CDS interventions for GPM have not yet been rigorously assessed for their clinical impact.

Strengths and limitations

As one important strength of this study, as far as we are aware, this work represents the first systematic review on CDS for GPM. As such, it contributes an important perspective on a topic that has the potential to have significant impacts in both clinical medicine and biomedical informatics. As a second strength, this systematic review was based on search strategies refined through previous systematic reviews on related topics.1416 Third, we searched Embase in addition to MEDLINE, so as to provide greater coverage of the international literature. Finally, in addition to providing a summary of relevant manuscripts, this review provides insights and trend analyses that show how this scientific field has developed over time and where the field appears to be headed moving forward.

In terms of limitations, this study does not provide a quantitative meta-analysis of the impact of CDS interventions for GPM. However, such a meta-analysis was not possible due to the limited number of outcome studies in this field and the heterogeneous nature of the various interventions and clinical domains. Second, we only included manuscripts written in English, which may have led to some relevant manuscripts being excluded that were written in a different language. Third, some relevant 2011 articles may not have been indexed by the time of our literature search and therefore erroneously excluded. However, a literature search update in June 2012 added less than 1% to the number of articles we had previously retrieved through March 2012, which suggests that this risk is low. Finally, there is a potential for publication bias with regard to the clinical trials included, in which studies with successful outcomes were more likely to be published than studies with unsuccessful outcomes. There was a potential indication of such a bias, in that seven of nine RCTs evaluated (77%) reported positive results, whereas the expected rate of positive results would more typically be in the range of approximately 60%.56 However, given the limited sample size, the observed discrepancy may simply be due to chance. Moreover, as discussed next, the high rate of successful interventions may be partly explained by the fact that use of many of these systems was required by the study protocol, which improved the systems’ likelihood of use and impact.

Consistency of trial findings with expected outcomes

In a previous systematic review of CDS RCTs, we identified the automatic provision of CDS as a part of routine clinical workflow to be a critical predictor of the success or failure of CDS interventions (adjusted OR of 112.1, p<0.00001).14 While automatic provision of CDS was not a guarantee of success in this systematic review, a lack of this feature was associated with negative outcomes in all cases, generally due to the lack of use of the system.14 Moreover, a later RCT specifically evaluating the importance of automatic provision of CDS directly confirmed this finding.57

On initial examination, the results of the present systematic review seemed to contradict this finding, as we found several RCTs in which stand-alone CDS interventions for GPM were not provided automatically as a part of routine clinical workflow but resulted in positive improvements in clinical practice.21,25,28,29,36,39 However, in all but one of these RCTs,21 use of the CDS system was mandated by the study protocol, which was an exclusion criterion in the previous systematic review that identified the critical importance of the automatic provision of CDS.14 Therefore, we believe it is premature to draw the conclusion that automatic provision is not important when providing CDS for GPM, as it is possible that the same CDS interventions that led to positive results in the studies included would not have led to positive results if use of the system was not mandated by the study protocol, due to lack of awareness and use of the tool. With regard to other, less critical success factors identified in the previous systematic review of CDS interventions,14 we did not find any trends that contradicted those findings. However, the sample size of available CDS trials was too small in this study to allow for any meaningful analysis of these other factors.

Of note, in the RCT of the GRAIDS system for FHx-based CDS, the system did have a positive impact, even though its use was not mandated by the study protocol and the system was not automatically provided as a part of routine clinical workflow.14 However, the use and impact of this system may have been the result of exceptional circumstances specific to the study context and unlikely to be available in a routine clinical practice setting. In particular, in the RCT of the GRAIDS system, designated clinicians were recruited at each practice, received extensive training on GRAIDS, and managed all patients in the practice expressing concern regarding their breast or colorectal cancer FHx.21 This type of resource-intensive deployment strategy may not be feasible outside the context of a research study, as demonstrated in another RCT of a stand-alone breast cancer CDS tool, which had limited impact due largely to the lack of awareness and adoption of the tool by clinicians.24 Therefore, while more evidence is needed before a solid conclusion can be drawn, we found no conclusive evidence that CDS for GPM is unique in terms of the intervention features required for successful outcomes.

Assessment of current research state and required research

In recent years, CDS has been proposed as a promising approach to realizing the promise of GPM.1012,5865 However, we identified only 38 primary research articles published from 1990 to 2011 on the design, implementation, use, and evaluation of CDS systems to support genetically guided patient care, which amounts to approximately 1.7 articles per year. Even in the year with the most publications on this topic (2011), we identified only six primary research articles. In particular, we identified only nine RCTs of the impact of CDS systems for GPM, seven articles focused on CDS integrated with primary clinical information systems, and 16 articles involving the use of genotype to drive CDS. Furthermore, few groups have demonstrated how genotype-driven CDS can be integrated into clinical settings and clinical information systems in a scalable, standards-based, and effective manner.40,43,52,53

Given the tremendous volume of research being conducted in the discovery of novel personalized medicine diagnostics and therapeutics, we feel that much more research is required on how CDS can and should be leveraged to take these discoveries and to implement them in routine clinical practice. For example, even for FHx-driven CDS, which is perhaps the most well-established area of research with regard to CDS for GPM, there has been limited research on the optimal use of FHx-driven CDS tools beyond hereditary cancer management. Indeed, given the limited literature available on any one topic, we feel it would be premature to consider any aspect of CDS for GPM to be fully mature and not in need of any further research.

In looking forward, we believe that the largest looming research challenge in terms of CDS for GPM will be the development of effective approaches to manage and utilize whole genome sequence data in the clinical setting. The pursuit of low-cost whole genome sequencing has been a priority research area for many years, such that sequencing costs may be reduced to a level amenable to routine clinical use in the near future.66 While sequencing technologies continue to advance, the informatics capabilities to apply whole genome sequencing data to clinical practice is still in its infancy.67 Indeed, in our systematic review, we did not find a single primary research article addressing this topic. Therefore, we recommend the prioritization and resourcing of this area of research by the scientific community. In particular, to realize the full clinical potential of whole genome sequence data, we believe that approaches will need to be developed for providing advanced CDS capabilities that are integrated with clinical information systems and provided automatically as a part of routine clinical workflow.

Conclusion

The promise of GPM is growing with the recent advances and discoveries in genomics research. With this growth also comes the growing need for translating such discoveries into everyday clinical care, so that we are able to realize the promises of GPM. CDS has the potential to bridge this gap between the promise and realization of GPM. By systematically reviewing the literature in this field and by identifying gaps in required research, we speculate that this paper will assist with efforts to leverage CDS to enable GPM at scale.

Contributors

BMW and KK both contributed to the design and conduct of the study, as well as the preparation of the manuscript.

Brandon M Welch

Kensaku Kawamoto

Funding

This study was funded by grant K01HG004645 from the US National Human Genome Research Institute, the University of Utah Department of Biomedical Informatics, and the University of Utah Program in Personalized Health Care. The funding sources played no role in the study design, in the collection, analysis and interpretation of data, in the writing of the manuscript, or in the decision to submit the manuscript for publication. The views expressed in this manuscript are those of the authors alone and do not necessarily reflect the official views of the National Human Genome Research Institute or of the University of Utah.

Competing interests

BMW is the founder and owner of SGgenomics, Inc., which developed ItRunsInMyFamily.com, a patient-centered FHx tool. KK is serving as a consultant to Inflexxion on a project funded by the National Institute on Drug Abuse to develop CDS capabilities for mental healthcare. KK receives royalties for a Duke University-owned CDS technology for infectious disease management known as CustomID that he helped develop. KK was formerly a consultant for Religent, Inc. and a co-owner and consultant for Clinica Software, Inc., both of which provide commercial CDS services, including through use of a CDS technology known as SEBASTIAN that KK developed. KK no longer has a financial relationship with either Religent or Clinica Software.

References: Click Here

Related Articles