14:55, 27th April 2022
CDISC Open-Source Alliance
The CDISC Open-Source Alliance maintains a directory of repositories that have been officially recognised as open-source projects aimed at implementing or developing CDISC standards, with the goal of fostering innovation within the CDISC community. Each project must satisfy specific inclusion criteria before being listed in the directory, and smaller projects that emerge from hackathons are catalogued separately in a dedicated hackathons panel.
14:54, 27th April 2022
OpenClinica is a modular eClinical platform designed primarily for small to midsize organisations involved in clinical research, including academic institutions, sponsors, contract research organisations and biotech companies. It brings together electronic data capture, electronic consent, patient-reported outcomes, randomisation, EHR integration, analytics and patient recruitment into a single offering, with the stated aim of reducing the time required to launch a study from several months to just a few weeks.
Each client is assigned a dedicated Customer Success Manager rather than being directed to a general support queue, and the platform also provides around-the-clock application support for most of the working week, alongside an on-demand training system. Organisations can either configure studies themselves using drag-and-drop tools and pre-built templates, or engage the platform's professional services team to handle the build on their behalf.
The platform claims to reduce data queries by around half and to deliver patient recruitment at significantly lower cost per conversion than traditional approaches. Having reportedly supported more than 15,000 studies and three million patients globally, it positions itself as a practical middle ground between overly complex enterprise systems and tools that lack the necessary rigour for regulated clinical research.
15:49, 21st March 2022
Download, Tidy and Visualize Covid-19 Related Data
The Mathematics and Statistics of Infectious Disease Outbreaks
The tidycovid19 R package, created by economist Joachim Gassen, aggregates and tidies COVID-19 related data from multiple authoritative sources to support research into the pandemic, with a particular focus on non-pharmaceutical interventions. Data are drawn from organisations including Johns Hopkins University, the European Centre for Disease Prevention and Control, Our World in Data, the World Bank, ACAPS, Oxford University and Google and Apple mobility reports, all accessible through dedicated download functions. The package also includes visualisation tools for plotting the spread of the virus, generating stripe-based country comparisons and mapping global or regional trends, as well as a Shiny app for interactive exploration. A separate but related GitHub repository hosts materials for the MT3002 summer 2020 course on the mathematics and statistics of infectious disease outbreaks, delivered at Stockholm University by Tom Britton and Michael Hohle, covering topics such as epidemic modelling, reproduction numbers, vaccination, outbreak detection and COVID-19-specific analyses through video lectures, slides and accompanying R code.
15:30, 21st February 2022
Best Data Science Books For Beginners
For those looking to enter the field of data science, a strong grounding in programming, machine learning, probability, statistics and linear algebra is essential, and a range of books exists to help beginners build these skills. Among the most recommended are "Data Science from A-Z" by Benjamin Smith, which offers a clear and balanced introduction to core concepts, and "Data Science for Dummies" by Lillian Pierson and Jake Porway, which focuses on practical business applications and covers big data frameworks such as Hadoop and Spark.
Cole Nussbaumer Knaflic's "Storytelling with Data" takes a narrative approach to teaching data visualisation, while Joel Grus's "Data Science from Scratch" walks readers through Python, statistics and machine learning from the ground up. Jake VanderPlas covers key Python libraries in the "Python Data Science Handbook", and Wes McKinney's "Python for Data Analysis" is particularly suited to those new to both Python and analytical computing.
For those preferring R, Hadley Wickham's "R for Data Science" provides thorough coverage of the language. Statistical foundations are addressed by Gareth James and co-authors in "An Introduction to Statistical Learning" and by Peter Bruce in "Practical Statistics for Data Scientists", while Sheldon Axler's "Linear Algebra Done Right" and Blitzstein and Hwang's "Introduction to Probability" cover the underlying mathematics. Machine learning is explored practically in books by Andreas Muller and Sarah Guido and by Aurelien Geron, whose hands-on approach uses Scikit-Learn and TensorFlow, and Yves Hilpisch rounds out the selection with a finance-focused application of data science methods using Python.
22:02, 29th January 2022
OpenCPU is an HTTP-based API system for executing R functions and scripts remotely, using standard GET and POST methods to retrieve objects and perform remote procedure calls, respectively. The API is structured around a configurable root path and exposes endpoints for accessing installed R packages, their functions, datasets and documentation, as well as temporary sessions that store the outputs of function or script executions. R objects can be retrieved in a range of formats including JSON, CSV, PDF and PNG, and function arguments can be passed using several content types such as URL-encoded form data, multipart form data or JSON.
Scripts are executed by posting to their file path, with the interpreter determined by file extension, supporting formats including R, LaTeX, knitr and Markdown. A simplified JSON RPC mode is available for cases where only the output data are needed, returning results directly in a single request rather than requiring a follow-up retrieval step. The system also supports static web applications bundled within R packages and offers continuous integration with GitHub, whereby pushing a commit to a repository's master branch can trigger automatic package installation on an OpenCPU server.
08:54, 24th January 2022
The High-Paying Side Hustles for Data Scientists
The rise of remote working since the COVID-19 pandemic has led many data scientists to explore ways of supplementing their income through side work. Freelancing platforms such as Upwork, Toptal, AngelList and Kolabtree offer varying levels of entry, from open project bidding to elite networks requiring several years of experience.
Technical writing is another viable avenue, whether through blogging on platforms like Medium, contributing articles to publications that offer financial rewards based on readership, or taking on ghostwriting work that, while uncredited, tends to pay at a premium rate. Contract work, covering areas such as machine learning model design, data analysis and research, offers clear terms and flexible hours.
Consultancy, typically charged at an hourly rate, suits those with substantial field experience who can advise companies on data science strategy and investment. Career coaching rounds out the options, with platforms connecting experienced professionals with graduates and jobseekers needing guidance on interviews, networking and career direction. Beyond immediate earnings, these pursuits can broaden professional experience, strengthen a personal brand and contribute meaningfully to long-term career development.
14:00, 23rd December 2021
SciML is an open-source ecosystem designed for scientific machine learning, offering a modular framework that integrates differentiable programming with physics-informed AI to solve complex problems in differential equations, nonlinear systems and inverse problems. Built primarily in Julia, it leverages high performance and scalability through distributed and GPU parallelism, while supporting interoperability with Python and R via tools like diffeqpy and diffeqr.
The ecosystem includes advanced solvers for a wide range of equations, automated model discovery tools and methods for sparsity acceleration and compiler-assisted analysis, enabling efficient simulation and optimisation. It also provides ML-assisted tools for accelerating scientific computations, such as neural differential equations and surrogate models, alongside extensive community resources for collaboration and support. The platform fosters research and development through a large contributor base and a suite of tools for benchmarking and testing new methodologies, aiming to bridge the gap between theoretical advancements and practical applications in scientific computing.
18:33, 10th December 2021
SAS Institute has shared a few COVID resources for data scientists and others, so I have shared links to them here as well:
8 terms you need to understand when assessing COVID-19 data
Vaccine Efficacy, Clinical Trials, and SAS: Part 4 of Biostats in the Time of Coronavirus
16:46, 2nd December 2021
DataKind UK is a charity that supports third-sector organisations in the UK by enhancing their use of data analysis and science to address social challenges. Established in 2013, it connects these organisations with skilled volunteers who provide free, expert assistance to improve decision-making, build capacity and drive innovation. By fostering collaboration between data professionals and charities, voluntary groups and social enterprises, the organisation helps its partners navigate complex issues, leverage insights from data and strengthen their impact. Over the years, it has supported more than 280 organisations through hundreds of projects, contributing thousands of pro bono hours and demonstrating the value of data-driven approaches in addressing societal needs.
16:49, 21st October 2021
Open Neural Network Exchange (ONNX)
An open format designed to enable machine learning models to be used across various frameworks and hardware, ONNX provides a standardised set of operators and file formats that facilitate compatibility between different tools and runtimes. It supports a wide range of frameworks and accelerators, allowing developers to leverage hardware optimisations while maintaining flexibility in model development. As a community-driven project, ONNX encourages collaboration through contributions, working groups and events such as meetups and surveys aimed at gathering feedback to guide its ongoing development.