Generated by All in One SEO Pro v5.0.1, this is an llms-full.txt file, used by LLMs to index the site. # Link Digital Link Digital: Global experts in CKAN, open data solutions, and complex data ecosystems. ## Posts ### [How CKAN helps power Indigenous data sovereignty in Canada](https://linkdigital.com.au/news/2025/08/how-ckan-helps-power-indigenous-data-sovereignty-in-canada/) **Published:** August 28, 2025 **Author:** Andrew Nette **Excerpt:** Let’s look at the role that the open source software known CKAN plays in helping to power Indigenous science and data sovereignty in Canada. Read the article. **Content:** Obviously, open data portals and their managers need to adopt a different approach when working with Indigenous people and rights holders and their data. Data sharing needs to take place within a framework of Indigenous control, and it must deliver some sort of collective benefit to the Indigenous community who owns the data. ## **Indigenous rights through collaborative research** One portal that works closely with Indigenous rights holders is the [Canadian Watershed Information Network](https://canwin-datahub.ad.umanitoba.ca/) (CanWIN), an open data portal managed by [University of Manitoba’s Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/) (CEOS). CEOS is a collaborative research centre focused on understanding how the earth will respond to climate change, with the Arctic freshwater marine system a particular focus due to the acute impacts of climate change on it. CanWIN collects and manages a large array of climate and hydrological data generated by this research and shares it with researchers and other stakeholders, including Indigenous groups. CanWIN’s role in supporting Indigenous knowledge was the subject of a recent presentation by [Ian Ward, Senior Solutions Architect at Link Digital](https://www.linkedin.com/in/ianward/?originalSubdomain=ca) to the 2025 [International Humanitarian Technology Conference](https://2025.ieee-ihtc.org/) (IHTC), in Edmonton, Alberta Canada, in early August. Let’s look at Ian’s talk on how CanWIN supports Indigenous knowledge and the role that the open source software known as CKAN – [the Comprehensive Knowledge Archive Network](https://ckan.org/) – the technological backbone of the portal, plays in facilitating this. ## **Data and Indigenous control** The IHTC conference brought together a range of people from different sectors to present on the challenges, success stories and lessons learned from tech innovation related to meeting the [United Nations’ Sustainable Development Goals](https://www.undp.org/sustainable-development-goals) (SDG). While [CKAN](https://linkdigital.com.au/ckan/) has long been recognised as a powerful open-source data management system, it is also a [Digital Public Good](https://digitalpublicgoods.net/), a status granted to open-source solutions that contribute to the UN’s SDGs. A decentralised open access ecosystem that fosters research collaboration and knowledge sharing, CanWIN consists of multiple platforms that host data directly or federate from external providers. In 2020 [Link Digital](https://linkdigital.com.au/) was engaged to completely overhaul the portal using [CKAN](https://linkdigital.com.au/ckan/) as its backbone. The portal supports the [FAIR](https://www.go-fair.org/fair-principles/) principles for data sharing: findable, accessible, interoperable, reusable. But because the portal works closely with Indigenous groups in Canada, it also attempts to operationalise the [Care Principles for Indigenous Data Governance](https://www.gida-global.org/care) and the First Nations principles known as [OCAP](https://fnigc.ca/ocap-training/). ![Ian Ward presenting at the 2025 International Humanitarian Technology Conference in Edmonton, Alberta, Canada](https://linkdigital.com.au/wp-content/uploads/2025/08/Ian-Ward-presenting-at-the-2025-International-Humanitarian-Technology-Conference-in-Edmonton-Alberta-Canada-Photo-credit-Marvellous-Ifezue-1024x576.jpg)*Ian Ward presenting at the 2025 International Humanitarian Technology Conference in Edmonton, Alberta Canada. Photo credit: Marvellous Ifezue.* ## **CARE and OCAP Principles** According to its website, CARE Principles “are people and purpose-oriented, reflecting the crucial role of data in advancing Indigenous innovation and self-determination. These principles complement the existing FAIR principles encouraging open and other data movements to consider both people and purpose in their advocacy and pursuits.” The OCAP Principles – ownership, control, access, and possession – are designed to protect Indigenous ownership, control and stewardship of their data, based on the understanding that Indigenous people are in the best position to understand their own needs and govern how their data and information should be used. In other words, they should have the right to decide who should use their data and under what conditions. Both the Care and OCAP Principles also include standards that researchers should follow in terms of their use of Indigenous data. These include that the data belongs to the Indigenous community, and they should oversee how it is used and shared and be able to take on the tasks around data sharing themselves, if they so choose. Every aspect should be documented in their languages. ## **Explaining why CKAN is the ideal data management system** The flexible and non-proprietorial nature of open source tools and software, such as [CKAN](https://linkdigital.com.au/ckan/), are ideal in this context, allowing users to avoid vendor lock-in, i.e., when users become dependent on a specific vendor for updates, support and maintenance, and compatibility with other software and, and cannot easily switch to an alternative solution or another vendor. They also give the user greater data sovereignty and the ability to set preferred standards of security, as well as complete control of their data and metadata. ## **CanWIN’s role in supporting indigenous data sovereignty** In his conference presentation, Ian outlined some of the many ways the CanWIN portal specifically supports the goal of Indigenous data sovereignty. “CanWIN supports publishing all kinds of assets to support indigenous ownership of not only the data, but the whole process including steps to clean data and record which instruments were used, and platform-specific documentation. ‘Codebooks’ and ‘cookbooks’ are created for internal and user-facing documentation.” Covering every step of the process – including installation, trouble shooting and equipment testing, and data processing and analysis – this comprehensive, publicly hosted documentation is a vital tool for empowering Indigenous communities, and allows them to independently manage and validate their data. “GitLab private repositories are used for internal data, processes and documentation and public repositories are used for shared tools and source code.” According to Ian, the CanWIN site makes use of other CKAN features in its work with Indigenous people. “Multilingual features are key for supporting Indigenous science and CKAN has great multilingual support, including for custom metadata and project documentation.” CKAN not only facilitates making [data easily accessible for Indigenous communities but creates](https://linkdigital.com.au/news/2024/11/how-to-create-brilliant-data-workflow-patterns-with-ckan/) intuitive data visualisations that can help simplify data access, analysis and interpretation for communities. CKAN’s data curation workflows ensure the provenance of data collected – where it has come from, how it was created and how it has been transformed and modified over time – which fosters community confidence in the ownership and management of data. “As a fully open source project supported by a global community of contributors CKAN offers flexibility not found in proprietary offerings. This flexibility is critical for supporting Indigenous authority to control data that is collected on their territories. Access to CKAN and related tools for data curation also provides collective benefit for the community.” ## **Manitoba Métis Federation’s Weather Keeper Program** A good example of CanWIN’s approach to Indigenous data is the [Manitoba Métis Federation’s Weather Keeper Program](https://canwin-datahub.ad.umanitoba.ca/data/project/mmf-weather-keeper), a collaboration between CEOS and the Manitoba Métis Federation (MMF), an Indigenous government recognised by the federal Canadian authorities. The program supports the collection of atmospheric data in the Manitoba Great Lakes region from watershed samplings supplemented by data collected by a network of 3-meter high weather stations installed on MMF land and operated by MMF citizens. This project is being done with a view to providing insights into how the region is responding to weather changes, including providing a snapshot of the impacts of climate change. MMF citizens maintain the weather stations and provide regular status reports of the data collected by them. Online data dashboards show the current weather conditions and provide a place to download or map additional data. ![Indigenous data sovereignty - Manitoba Métis Federation’s Weather Keeper Program](https://linkdigital.com.au/wp-content/uploads/2025/08/Source-CanWIN-site--1024x609.png)*Source: Canadian Watershed Information Network* As part of his presentation, Ian outlined how the project conforms to OCAP and CARE Principles: - On the program page, the project description was translated into the two key languages of the Metis Nation – Michif and French. Map stories are created in English, Michif and French to tell the story of the project in plain language. - Cookbooks and codebooks were created to describe in detail the processing steps and scripts used. - All installation, processing and troubleshooting guides are hosted publicly under the MMF’s management. - The project aims to provide Métis citizens with a better understanding of the impacts of climate change on them by providing relevant data on water and weather conditions. “CKAN is designed to be easy to integrate into any kind of data flow,” notes Ian. “This makes it easy to connect with the near real-time weather data feeds, Grafana visualizations and GeoNode spatial data from the Weather Keeper Program. Being one of a number of open source tools used in the program, CKAN gives the Manitoba Métis Federation ownership and control of their data in a way that’s not possible with proprietary software.” “CanWIN is an inspiring project. It was a privilege to be able to present it at IEEE IHTC 2025 on behalf of the University of Manitoba’s Centre for Earth Observation Science.” Canada has made significant investments in research infrastructure, yet challenges remain in making environmental data more accessible and usable. CanWIN offers a decentralized platform, aligned with recognised principles of Indigenous data management. And by prioritizing ethical data stewardship and knowledge coproduction, CanWIN fosters collaboration while supporting reconciliation efforts. --- **You can also read:** - [The CKAN case study of Link Digital on the redevelopment of the CanWIN site.](https://linkdigital.com.au/case-studies/canadian-watershed-information-network-canwin/) - [Our interview with Claire Herbert, Head of Digital Strategy at CanWIN.](https://linkdigital.com.au/news/2025/04/from-collecting-data-to-telling-stories-a-cost-effective-journey-in-freshwater-data-management/) ### **Do you need help with your data portal?** [Link Digital CKAN experts are ready to help you.](https://linkdigital.com.au/get-in-touch/) **Categories:** All articles, CKAN, Environmental/Climate Change, Environmental/Climate Change, Higher Education/Research **Tags:** Canadian Watershed Information Network, Indigenous data governance, Indigenous knowledge, United Nation's Sustainable Development Goals --- ### [From collecting data to telling stories: a cost-effective journey in freshwater data management](https://linkdigital.com.au/news/2025/04/from-collecting-data-to-telling-stories-a-cost-effective-journey-in-freshwater-data-management/) **Published:** April 29, 2025 **Author:** Andrew Nette **Excerpt:** A question being asked more by data managers is, how do you move the data on your portal into the hands of different audiences? **Content:** ## Table of contents - [The question being asked by data managers…](#aioseo-the-question-being-asked-by-data-managers) - [CEOS and CanWIN](#aioseo-ceos-and-canwin) - [A lot of data, but is it doing anything?](#aioseo-a-lot-of-data-but-is-it-doing-anything) - [Open source a gamechanger in research environments](#aioseo-open-source-a-gamechanger-in-research-environments) - [Information sharing data made sense](#aioseo-information-sharing-data-made-sense) - [Using a portal be used to tell better stories with data](#aioseo-using-a-portal-be-used-to-tell-better-stories-with-data) - [A change to combine multiple datasets](#aioseo-a-change-to-combine-multiple-datasets) - [CKAN will play a key role in these plans](#aioseo-ckan-will-play-a-key-role-in-these-plans) - [Want to create a data portal? Don’t reinvent the wheel!](#aioseo-want-to-create-a-data-portal-dont-reinvent-the-wheel) ## **The question being asked by data managers…** A question being asked more by data managers is, *how do you move the data on your portal into the hands of different audiences*? Not just expert groups like researchers and policy analysts, but local communities who can use the insights generated by the data to act on the issues of most concern to them. [Claire Herbert, Head of Digital Strategy](https://www.linkedin.com/in/claire-herbert-mb/?originalSubdomain=ca) at the [Canadian Watershed Information Network](https://canwin-datahub.ad.umanitoba.ca/) (CanWIN), an open data portal managed by [University of Manitoba’s Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/) (CEOS), is one data manager for whom this concern is front and centre. ## **CEOS and CanWIN** CEOS is a leading multidisciplinary and collaborative research centre focused on understanding how the earth will respond to climate change. It conducts fieldwork globally, with the Arctic freshwater marine system a particular focus due to the acute impacts of climate change on it. CanWIN is the data portal that collects and manages the large array of climate and hydrological data generated by this research, including detailed spatial data, and shares it with researchers. [But the portal also works with other stakeholders, including Canadian indigenous rights holders.](https://linkdigital.com.au/news/2025/08/how-ckan-helps-power-indigenous-data-sovereignty-in-canada/#:~:text=One%20portal%20that,in%20facilitating%20this.) > What they really want to know is, how is climate change affecting my bay which my community depends on for multiple uses. > To be able to tell that story, as a researcher, I need access to multiple types of data, for example, weather station data, atmospheric and water quality data, etc. And then I can put all those datasets together and actually make a story about it. I can say I have analysed all these different bits of data, and this is the result. From this ten-year study I can see that water quality has changed over time in the area, you’re getting more algae blooms, and the water temperature has increased by two degrees. And we know from global climate change patterns that this is typical of climate change. Herbert believes an important task for CanWIN > is trying to get out science facts in a way that is understandable to the public and tells a story about a relevant topic. ## **A lot of data, but is it doing anything?** The original CanWIN database was developed by Canada’s federal government to host freshwater data collected by various departments and agencies, often going back decades, but which was completely unorganised and largely inaccessible. > Biological data. Physical data. Geological data. A lot of that information was originally hard copies, before we had computers. A lot of it wasn’t digitalised, even after we had computers. And what was digitised was in multiple government departments around the country. The problem came to a head for Herbert, a freshwater biologist by training, while she was working for [the Department of Fisheries and Oceans](https://www.dfo-mpo.gc.ca/videos/freshwater-institute-institut-eaux-douces-eng.html). The agency had been collecting freshwater data going back decades, but the data was inaccessible to the public, and many other freshwater datasets were stored in different databases around the country. Parallel to this, another government department responsible for the sharing of water related data, [Environment and Climate Change Canada](https://www.canada.ca/en/environment-climate-change.html), realized they had a similar problem, and started to think about different data management solutions but faced major difficulties. They were using a proprietary database system mandated by the government. It was expensive and the database’s structure had a very specific schema that made it inflexible and complex to use, particularly for its users, who were scientists not database experts. Herbert even took a diploma in database administration, to try and figure out how to better manage data. > So, long story short, then the government entered into an agreement with the University of Manitoba for us to host that freshwater database and I was hired to manage it. ## **Open source a gamechanger in research environments** It was while she was trying to understand all the different types of freshwater data that existed and how they were collected, that Herbert realised how much a structured proprietorial database solution was unsuited to an environment in which researchers are always adding variables to collect information in a way that makes sense. She started looking at open source technology. CanWIN was originally created as a relational database using the open-source technology, Visual Studio. Ultimately, however, this was not able to capture and share the complexity of the multi-disciplinary data produced and stored on the portal. In 2020, [Link Digital](https://linkdigital.com.au/) was engaged to completely overhaul the portal using [CKAN (the Comprehensive Knowledge Archive Network)](https://ckan.org/) as its backbone, along with [Drupal](https://new.drupal.org/home) for content management. CKAN’s modular structure made it flexible and easy to customise with extensions. > Extensions are really important to what we do. [CKAN](https://linkdigital.com.au/ckan/) also aligned with the funding structure of higher education, which is mainly grant-based, and thus largely rules out having the budget to fund an expensive, ongoing software licence with a proprietary vendor. ## **Information sharing data made sense** > We designed CanWIN specifically to focus on freshwater and Arctic data. We did not try and do everything. And we chose CKAN ultimately because it gave us the flexibility to create a space where we felt we could share the information in a way that made sense.’ As part of this, Herbert adds, ‘we work in a lot of developing countries, so I didn’t want to build something that couldn’t be used by any collaborators because it was too costly. The other gamechanger was CKAN’s ability to help CEOS develop consistent, standardised metadata schemas. This enables researchers to understand the type of data, how it was collected and what instruments were used to collect it. They were also able to create a common data dictionary that researchers working across the globe were able to use to compare data, especially when they wanted to look at the effects of things like climate change on a system. [CKAN](https://linkdigital.com.au/ckan/) also offered the ability to create a user-friendly backend. While CanWIN staff still do a lot of the actual uploading of data, > we can give researchers access to be able to upload the data themselves. We can have required fields, not required fields, controlled vocabularies, drop-down menus. And the fact that we have it wrapped in Drupal, that makes a huge difference and makes it more user friendly. CanWIN currently hosts 124 datasets, each of which contains between three and seven resources, which are often their own datasets. But an additional 34,000 datasets are searchable from other data portals CanWIN federates: [Canada’s national open data portal](https://search.open.canada.ca/data/) and the [Columbia Water Basin Hub](https://data.cbwaterhub.ca/), run by [Living Lakes Canada](https://livinglakescanada.ca/), a charitable water stewardship non-government organisation working with community groups to protect freshwater. ![Screenshot of the CanWIN (Canadian Watershed Information Network) homepage](https://linkdigital.com.au/wp-content/uploads/2025/04/canwin-datahub.ad_.umanitoba.ca_.png)Case study: [The Canadian Watershed Information Network](https://linkdigital.com.au/project/canadian-watershed-information-network-canwin/) ## **Using a portal be used to tell better stories with data** CanWIN’s initial mission was to improve the collection and sharing of freshwater data. With the upgrade, it moved to help researchers better tackle the complexity of the multi-disciplinary data they were collecting, including showing the relationships between the data and the larger projects they were related to, and the instruments used to collect it. The next stage of CanWIN’s evolution includes plans to increase the number of hubs it pulls data from. But the central concern, according to Herbert, is getting the data out to communities. Anyone can already access the data on the portal easily. Likewise, CanWIN can generate metrics that allow its team to track where datasets were used in public policy documents. But Herbert believes this approach is not enough and a bigger effort needs to be made to simplify access to the data and make it more understandable for a non-expert audience. ## **A change to combine multiple datasets** One change will seek to improve CanWIN’s main landing page to better highlight research reports featuring data the portal hosts. Another idea is specially produced plain language knowledge products combining multiple datasets from the portal to tell a more comprehensive story. > ‘Elevated summaries that contain what you might want to tell a politician in two minutes that’s important to them. And those knowledge products can then be used to inform policy about topics like climate change.’ > Knowledge products mean there are multiple actions you can do from them. They can be used to inform policy, but they can also be used to take to a community for information. They can also be used to teach in a school. They are a method to get science facts out to the public, especially in an era where it’s so easy to spread misinformation. And where they want to, people can also connect with the researcher who collected that data and ask questions or collaborate with them. ## **CKAN will play a key role in these plans** > CKAN allows us to not only host the data that we collect, but to standardize it into common language terms that everyone can understand. So, I don’t have to be a weather station specialist to know what barometric pressure means, because that description will be in there. ## **Want to create a data portal? Don’t reinvent the wheel!** Herbert has advice for those starting their own journey managing a data portal. > Based on my experience, I would say don’t reinvent the wheel. Start simple. What’s the most basic key component you need to have and then figure out who does them. Because there’s going to be people who already do them. Then figure out which tool is going to work for you. There’s almost nothing that people have to create themselves. > This is a problem that I still see in all the aspects of data management. People just want to always run in and do their own thing. And then you get isolated repositories that are absolutely no use in the long term or can’t be supported, because they are expensive or difficult to maintain. Linked to this, it is important to have an idea of your short and long term goals for your portal. > If you understand your goals, you can make a budget and try and figure out how you can actually sustain that portal in the long term and, if you can’t, look for alternatives. There are better ways, like collaborating with an existing repository, that may server you better with the money you have. - [Facebook](https://www.facebook.com/LinkDigital%20) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/%20) **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Geospatial, Higher Education/Research, Open Data **Tags:** data catalog, data collection, data storytelling --- ### [From climate data catalogues to dataset storage: the CKAN extensions that make it possible](https://linkdigital.com.au/news/2024/10/from-climate-data-catalogues-to-dataset-storage-the-ckan-extensions-that-make-it-possible/) **Published:** October 21, 2024 **Author:** Andrew Nette **Excerpt:** Link Digital CKAN experts recommend their most used or favourite CKAN extensions to extend the software's core power in relation to data management applications. **Content:** The [Comprehensive Knowledge Archive Network or CKAN](https://ckan.org/) is what is referred to as ‘out-of-the-box’ software. This means it can be configured and set up to power an open or internal data platform once it is deployed and hosted on a web server, without requiring significant extra effort from the user. This very basic or default functionality makes CKAN ideal for small users and those with significant software expertise or the resources to hire a specialist developer expertise, such as Link Digital. But CKAN’s power in relation to data management applications can be significantly extended through a large range of extensions, which add features and integrations to its core system. There are literally hundreds of CKAN extensions, far too many to talk about in this piece. So, to give current and potential CKAN users a taste of what extensions are on offer, I asked some of Link Digital’s staff, the people who work with CKAN every day, to recommend their most used, favourite or useful CKAN extension. ## **What is a CKAN extension?** But, first, what is an extension? From a technical point of view extensions are the Python programming language package (which corresponds with a GitHub repository – a storage space or project folder where all the software files and their revision histories are kept) that one installs in a CKAN site. Each extension provides one or more plugins that extend or modify CKAN’s basic default behaviour. A developer installs an extension, and its features then become available. For instance, the extension *[ckanext-spatial](https://github.com/ckan/ckanext-spatial)* provides various plugins, such as *spatial-query*, which are the ones that must be added to the configuration file. In a technical context the precise language that is used matters. For non-technical use, both the terms extension and plugin are often used interchangeably, although this article will use the former term throughout. Extensions can vastly increase CKAN’s basic functionality, integrate a CKAN application in a seamless manner with a user’s existing data and digital operations or allow a user to up-scale their CKAN application as their data needs grow. CKAN is open source software, meaning the original source code has been made freely available, allowing anyone to redistribute and modify it. One manifestation of this public ethos is the community of users and contributors around CKAN, who continuously contribute to the software’s design, development and defect correction. This is in addition to the efforts of a core development team who work to keep the CKAN software in good shape. Many of these people are also involved in development and updating of extensions. ## **How do extensions improve CKAN’s functionality?** There is a wealth of CKAN extensions, and the exact number only grows over time as the community around the software, including specialist digital service providers such as Link Digital, contribute more. These extensions cover everything from data visualisation and data storage improvements to custom theming and metadata standards compliance. You can get a sense of the additional functionality offered by CKAN extensions by exploring the [CKAN ](https://github.com/ckan)[Extensions Repository on GitHub](https://github.com/ckan) or on [CKAN’s extensions page](https://extensions.ckan.org/). [The GitHub page gives you an idea of extensions and their ‘forks’](https://github.com/orgs/ckan/repositories?q=sort%3Astars), a GitHub term for how many times a developer has made a copy of the extension and made extensions to the code, which is another way of saying how popular they are. Popular extensions include: - *[ckanext-geoview](https://github.com/ckan/ckanext-geoview)*, which contains plugins to display geospatial files and services in CKAN - *[ckanext-spatial](https://github.com/ckan/ckanext-spatial)*, an extension that provides some harvesters for importing ISO19139-based metadata into CKAN - *[ckanext-scheming](https://github.com/ckan/ckanext-scheming)*, a way to configure and share metadata schemas using a YAML (a data serialisation language used for configuring files) or JSON schema description (a file format and data exchange text to store and transmit data objects) - [ckan-nextpages](https://github.com/ckan/ckanext-pages), an easy way to add simple pages to CKAN But while the GitHub page tells you about the most used extensions, a better way to grasp the truly innovative nature of many of the CKAN extensions and how they can be used to upscale the power of your CKAN application, is to ask the people who work on the software every day. ### ***Sergey Motornyuk* – *Full Stack Developer/ Architect*** “A year ago, I created an extension called *[ckanext-collection](https://datashades.github.io/ckanext-collection/)*. In CKAN we have a lot of datasets and resources, a lot of pages and text to discover. Some portals and data catalogues literally have thousands of different dataset titles. And, of course, every file has a format. This extension helps in visualising those collections. You can describe what collection you are interested in, how you want it represented and the extension will build you a table on a page, or maybe a URL where you can download in a specific format all this data. Link Digital has used this extension when clients want their data to be shown in different formats. For example, for an internal asset register, it enables you to build a single table that can display a workflow of the various data requests, those that are pending, granted, etc. The extension can also be customised to show maybe a certain type of request, for example pending data requests.” ### ***Alex Gostev* – *Product and Growth Marketing Lead*** “There has been an extensive rewrite of the CKAN extension for the [Data Catalog Vocabulary](https://www.w3.org/TR/vocab-dcat-3/) called *[ckanext-dcat](https://github.com/ckan/ckanext-dcat)*[*.*](https://github.com/ckan/ckanext-dcat) DCAT is a standardised way to describe datasets in data catalogs and public facing data portals. It is designed to facilitate greater interoperability between data published on the web, for example, in [open data catalogues or public facing data portals](https://linkdigital.com.au/news/2024/09/what-is-dcat-and-why-is-it-important-for-data-catalogs-and-open-data-portals/). You can think of it as an enabler for many organisations in the European Union and United States as it’s the foundation that should be covered to adhere to current governmental requirements. It’s all about providing users with more comprehensive information about datasets. This means CKAN is staying up to date in terms of compatibility with the latest DCAT version, DCAT 3.” ### ***Anastasiia Shevtsova* – *UI/UX designer*** “I would like to recommend a CKAN extension that can be helpful for the aggregation of non-local data on the CKAN portal, *[ckanext-federated-index](https://github.com/DataShades/ckanext-federated-index).* This extension searches datasets, saves the title, description and shows it in the relevant search results. The user is redirected to the original portal when the dataset details page is opened. I can see a lot of benefits in this extension. It doesn’t require heavy resources for copying data to the portal. This is a lightweight solution. This solution is fast. There is no delay so users can see data in real-time. Information in datasets is not modified, it is verified and updated. The CKAN portal shows the original owner of the data and redirects users to the original portal for further details. This scheme also allows the creation of informative solutions that contain and provide users with all necessary data without a long search and lots of effort. I like this extension because as a designer I care about user experience, and this extension helps them to achieve their goals easily. We used it in our work on [the CanWIN site](https://canwin-datahub.ad.umanitoba.ca/#:~:text=CanWIN%20is%20the%20data%20centre,River%20Watershed%20to%20the%20Arctic.) for the University of Manitoba project, an [internal data management platform that collects and manages](https://linkdigital.com.au/services/internal-data-hub/) a large array of climate data, including spatial data, analyses and shares it with researchers.” ![ckanext-federated-index](https://linkdigital.com.au/wp-content/uploads/2024/10/Anastasia-Hybrid-search-local-federated-University-of-Manitoba-1024x687.png)*ckanext-federated-index* ### ***Ian Ward* – *Senior Solutions Architect*** “There are many great extensions so I can’t choose just one. *[ckanext-files](https://github.com/DataShades/ckanext-files) is* a new extension designed to enhance CKAN’s file management capabilities and has potential to open up many new workflows. *[ckanext-validation](https://github.com/ckan/ckanext-validation)* can be used to nudge users to publish higher-quality data which is so important for data reuse. *[ckanext-scheming](https://github.com/ckan/ckanext-scheming)* has become quite widely used for custom metadata schemas and is the basis for recent improvements to *[ckanext-dcat](https://github.com/ckan/ckanext-dcat),* another really important extension for publishing metadata in an interoperable standard. The *[ckanapi](https://github.com/ckan/ckanapi)* tool is great for automating bulk tasks with CKAN and integrating CKAN with other python projects.” ### ***Lex du Plessis* – *Technical Delivery Manager*** “I have a lot of extensions that I like but this one. It is called *[ckanext-gallery](https://github.com/NaturalHistoryMuseum/ckanext-gallery)*. It is from the [London Natural History Museum Portal](https://data.nhm.ac.uk/), which is powered by CKAN. [For example, we can see it here being used to catalogue butterflies](https://data.nhm.ac.uk/dataset/collection-specimens/resource/05ff2255-c38a-40c9-b657-4ccb55ab2feb?view_id=6ba121d1-da26-4ee1-81fa-7da11e68f68e&filters=project%3Apapilionoidea+new+types+digitisation+project). It generates a preview of the image that is attached to the dataset and displays that on the webpage. And I just think this is such a really cool way of sharing the data, especially for a catalogue that is based on images. It is kind of the detail that you want to show.” ![Screenshot of London Natural History Museum Portal using ckanext-gallery](https://linkdigital.com.au/wp-content/uploads/2024/10/Gallery-1024x575.png)**Screenshot of London Natural History Museum Portal using ckanext-gallery** ### ***Steven De Costa* – *Executive Director*** “The [*ckanext-hierarchy extension*](https://github.com/ckan/ckanext-hierarchy) is a powerful yet simple tool for enhancing the flexibility of a CKAN portal by allowing the creation of hierarchical structures within organizations. This extension makes it possible to manage user privileges more efficiently by assigning different access and publishing roles to sub-organizations. This is particularly useful for data custodians and teams, as they can distribute responsibilities while maintaining clear oversight. One of the key features I appreciate is its ability to preserve the organisational hierarchy when harvesting data from other portals. This means you can seamlessly integrate external data sources while keeping their structure intact, making it ideal for building a comprehensive metadata portal. For end users, the hierarchical access path offers an intuitive way to navigate and discover datasets, saving time and providing more focused search results.” ### ***Brett Jones* – *DevOps Engineer*** **“**The [CKAN DataStore plugin](https://docs.ckan.org/en/latest/maintaining/datastore.html) is personally one of my favourites when it comes to working with data on the CKAN platform. It adds a powerful and flexible backend that allows for easy storage, querying, and filtering of datasets in a more structured and manageable way. This plugin makes it possible to store data in a [PostgreSQL database](https://aws.amazon.com/free/database/?), which can then be queried directly through the CKAN API. This plugin is mature and easily installable. In the Tech Team we generally do not have many issues with this plugin. One of the key features that I really like is the ability to enable a data preview. Once the plugin is activated, users can interactively preview datasets right from the web interface. This is incredibly useful for exploring data before downloading it or running queries. You can see a sample of the dataset, which provides a clear and immediate understanding of the structure and content. Beyond that, the CKAN Datastore plugin offers support for filtering, sorting, and searching within the data, allowing users to extract just the pieces of information they need. For me, it’s an essential tool for making data more accessible and user-friendly, adding a lot of depth to CKAN’s already robust data management capabilities. It’s one plugin I always recommend to those looking to improve their CKAN experience.” ![Technical diagram of CKAN and PostgreSQL](https://linkdigital.com.au/wp-content/uploads/2024/10/Brett-image-1024x727.png)Technical diagram of CKAN and PostgreSQL [From climate data catalogues to dataset storage the CKAN extensions that make it possible](https://linkdigital.com.au/news/2024/10/from-climate-data-catalogues-to-dataset-storage-the-ckan-extensions-that-make-it-possible/attachment/from-climate-data-catalogues-to-dataset-storage-the-ckan-extensions-that-make-it-possible-1_compressed/) ## **Let’s talk CKAN extensions** Do you have a favourite CKAN extension? Or do you need a customised extension developed to meet a challenge you face in an open data portal or data catalogue? If so, [contact us](https://linkdigital.com.au/get-in-touch/) and tell us about your project. ## More articles - [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) - [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) - [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) - [When the visitors aren’t human: What rising bot traffic means for your data portal](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) - [From open data to verifiable honesty: An experiment you can look at](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) **Categories:** All articles, CKAN, Environmental/Climate Change, Geospatial, Industry, Open Data, Resources, Technology Infrastructure **Tags:** extensions, Link Digital staff, open data --- ### [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) **Published:** September 11, 2026 **Author:** Kate Sampher **Excerpt:** Rising bot traffic distorts analytics and increases infrastructure load, and a large share of it, around 40%, is also actively malicious.  **Content:** Rising bot traffic is not only a question of volume and cost. A large and growing share of it is harmful, and much of that harmful traffic exists to find and exploit vulnerabilities in your data infrastructure. [In a recent article](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/), we looked at what rising bot traffic means for your data portal in terms of measurement and infrastructure load. This piece looks at the security side of the same trend: what automated attackers are actually doing, how fast they move, and what portal owners can do to reduce their exposure to the risks they pose. ## **Automated web is now mostly non-human, and a lot of it is hostile** Automated traffic has overtaken people as the main source of online traffic. According to Imperva’s [2026 *Bad Bot Report*](https://www.imperva.com/blog/bad-bot-report-2026-bots-agentic-age/), bots accounted for more than 53% of all web traffic in 2025, up from 51% the year before, while human activity fell to 47%. Not all of that automation is friendly. Imperva classifies around 40% of all web traffic as malicious bot activity, [and this 2026 analysis](https://www.imperva.com/company/press_releases/ai-driven-bot-attacks-surged-12-5x-according-to-thales-bad-bot-report/) reports that AI-driven bot attacks rose roughly 12.5 times in a single year. The same research found that 27% of bot attacks now target APIs directly, bypassing the user interface entirely. For a public data portal, this means a meaningful slice of the requests hitting your server every day are not readers or researchers. They are automated systems, and some of them are looking for a way in. ![Bot traffic and vulnerabilities - share of all web traffic - Imperva 2026 Bad Bot Report - Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/09/2-Bot-traffic-and-vulnerabilities-1024x535.webp)## **From scanning to breach: what malicious bots actually do** Most bot-driven attacks fall into a recognised set of patterns. [Open Worldwide Application Security Project](https://owasp.org/) (OWASP) – a global nonprofit that provides free, open-source resources, tools, and standards to help make software and web applications more secure – maintains a catalogue of these under [Automated Threats to Web Applications](https://owasp.org/www-project-automated-threats-to-web-applications/). This describes the common ways bots and scripts are used to abuse a site at scale. The ones most relevant to a data portal are summarised below. **Automated threat****What the bot does****Why it matters for a portal**Vulnerability scanningProbes pages, forms, and endpoints for known weaknessesFinds unpatched software before you doCredential stuffing and brute forceTries stolen or guessed logins against admin and account pagesCan lead to account takeover and privileged accessAPI abuse and scrapingHits data and catalogue APIs at high frequencyDrives load, and can expose data or business logicContent and data scrapingCopies datasets and pages in bulkConsumes bandwidth and removes control over consumption Denial of serviceFloods the site with requestsMakes the portal slow or unavailable to human usersThe window to respond to malicious bots has narrowed sharply. Verizon’s [2026 Data Breach Investigations Report](https://www.verizon.com/business/resources/reports/dbir/) found that exploiting vulnerabilities has become one of the most common ways attackers first get into a network and that the average time from a vulnerability being disclosed to being actively exploited has fallen to roughly 10 hours. In practice, automated scanners begin testing a newly published vulnerability within the same day it appears and often much sooner. For public portals, the threat is not theoretical. In May 2026, the Drupal Security Team disclosed a highly critical SQL injection flaw in Drupal core, [SA-CORE-2026-004,](https://www.drupal.org/sa-core-2026-004) and updated the advisory to confirm that malicious bots were trying to exploit it. Sites on a supported version that patched promptly were protected, while sites left on unpatched or end-of-life versions were open to potential attacks. The take home lesson for portal owners is that the safety margin now sits in how quickly you patch a vulnerability, not in whether a flaw affects you. ## **Why data portals and public-sector sites are exposed** Open data, research, and government portals carry a specific risk profile, for three reasons. First, they are public by design. Being discoverable is usually the point, so the front door is open to everyone, including automated scanners. Second, they expose rich APIs. A data catalogue is built to be queried programmatically, which is a strength for legitimate users and a large attack surface for everyone else. Given that APIs are now the leading bot attack target, this issue matters. Third, they run on widely used software. Portals are commonly built on platforms such as CKAN, Drupal, and WordPress, and popular software attracts mass, automated scanning the moment a new flaw is published. ## **What can you do to counter these threats?** The single largest avoidable risk here is running unsupported versions. Drupal, for example, provides no security coverage for end-of-life branches, as noted in [SA-CORE-2026-004](https://www.drupal.org/sa-core-2026-004), which means a known flaw can remain open indefinitely. If you are approaching a version deadline, our guide on [planning a Drupal upgrade in 2026](https://linkdigital.com.au/news/2026/05/planning-a-drupal-upgrade-in-2026-here-is-what-you-need-to-know/) walks through the options. Integrity is part of the same picture. [As we discussed in this article in February](https://linkdigital.com.au/news/2026/02/ckan-roadmap-stability-speed-and-3-0/), recent CKAN work has added protections at the data layer. The just released CKAN version 2.12 introduces file-level hashing so a portal can detect whether a file has been tampered with or duplicated, which supports cleaner security audits. The earlier article on our site referred to above covered load-related steps such as caching, a CDN (content delivery network), and robots.txt. The list below focuses on the security side, and each item is within reach for a small team. 1. **Run supported, patched software:** Keep your content management system core, extensions, and dependencies current, and treat a critical advisory as a same-week task rather than a monthly one, given how fast disclosed flaws are exploited. 2. **Put a web application firewall (WAF) in front of the portal:** A WAF gives you enforceable rules that bots cannot ignore. It can be tuned against the OWASP automated threat categories. 3. **Protect authenticated endpoints:** Rate-limit and monitor login and admin pages, enable multi-factor authentication where possible, and watch for credential stuffing patterns. 4. **Secure and rate-limit your APIs:** APIs are the top attack surface, so apply authentication, quotas, and per-client limits to catalogue and data endpoints. 5. **Monitor your logs for scanning:** Be alert for unusual spikes to admin, login, and API paths, which are often the first sign of an automated probe. 6. **Reduce what is exposed:** Remove or lock down staging, test, and unused endpoints so there is less for a scanner to find. For a step-by-step starting point, our free [Bot Traffic Readiness Checklist](https://linkdigital.com.au/wp-content/uploads/2026/08/Bot-Traffic-Readiness-Checklist.pdf) is a one-page guide you can work through. ## How Link Digital can help If you would rather not manage these tasks in-house, that is what our [managed hosting service](https://linkdigital.com.au/services/managed-hosting/) is for. We handle patching, WAF configuration, rate limiting, monitoring, and bot management, and keep you informed on how your portal traffic is trending, so your team can stay focused on your data and your users. If you would like a review of what bot traffic and exposure currently look like on your portal, [contact us](https://linkdigital.com.au/get-in-touch/) and we can look at your logs and talk you through it. ## Frequently asked questions **Is bot traffic a security threat or just an analytics and cost problem?** It is both. Rising bot traffic distorts analytics and increases infrastructure load, and a large share of it, around 40%, is also actively malicious. **What kinds of attacks do malicious bots run against data portals?** The most common are vulnerability scanning, credential stuffing and brute-force login attempts, API abuse and scraping, bulk data scraping, and denial-of-service floods. OWASP catalogues these under Automated Threats to Web Applications. **How quickly are newly disclosed vulnerabilities exploited?** Very quickly. One report cited the average time from disclosure to active exploitation at around 10 hours, and automated scanners often begin testing a new flaw the same day it is published. **How do we reduce exposure without blocking legitimate crawlers and AI agents?** You should focus on security hygiene rather than blanket blocking. This means ensuring supported and patched software, placing a WAF in front of the portal, protecting and rate-limiting login pages and APIs, and monitoring logs for scanning. This keeps the portal discoverable while closing the gaps attackers look for. --- **Sources** - Imperva, [*2026 Bad Bot Report: Bots in the Agentic Age*](https://www.imperva.com/blog/bad-bot-report-2026-bots-agentic-age/) (bot share of web traffic, API attack share) - Imperva / Thales, [press release on the *2026 Bad Bot Repor*t](https://www.imperva.com/company/press_releases/ai-driven-bot-attacks-surged-12-5x-according-to-thales-bad-bot-report/) (malicious bot share, growth in AI-driven attacks) - OWASP, [Automated Threats to Web Applications](https://owasp.org/www-project-automated-threats-to-web-applications/) (taxonomy of bot-driven attacks) - Verizon, [*2026 Data Breach Investigations Report*](https://www.zerofox.com/blog/from-cve-to-breach-in-under-an-hour/), as reported by ZeroFox (time from disclosure to exploitation) - Drupal Security Team, [SA-CORE-2026-004](https://www.drupal.org/sa-core-2026-004) (highly critical SQL injection, in-the-wild exploitation, end-of-life coverage) **Categories:** All articles, CKAN, Digital Public Infrastructure, Drupal, Environmental/Climate Change, Government, Higher Education/Research, Industry, Internal data hub, Non-profit/NGO, Open Data **Tags:** automated traffic and security, Bot traffic, data portal security, Drupl --- ### [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) **Published:** September 3, 2026 **Author:** Kate Sampher **Excerpt:** CKAN 2.12 has been officially released. Link Digital’s CKAN experts contributed directly to several of the software's news features. See what's new. **Content:** CKAN 2.12 has been officially released. The potentially final release in the 2.x series delivers improvements to file management, DataStore performance, and the user interface, while laying the architectural groundwork for CKAN 3.0. We are proud that Link Digital’s CKAN experts contributed directly to several of the features in this release. --- **Content** - [More flexible file management](#aioseo-more-flexible-file-management) - [Faster downloads for large datasets](#aioseo-faster-downloads-for-large-datasets) - [Easier bulk clean-up](#aioseo-easier-bulk-clean-up) - [Front-end modernisation](#aioseo-front-end-modernisation) - [Security fixes and patch releases](#aioseo-security-fixes-and-patch-releases) - [Planning your upgrade?](#aioseo-planning-your-upgrade) --- ## **More flexible file management** A major change is how CKAN 2.12 handles files. With the upgrade, files in CKAN are no longer tied to resources but are now independent, trackable entities that can be managed on their own, with support for multiple storage backends used side by side. > With the new file management features, files are no longer just a resource field in CKAN, said Sergey Motornyuk, a Link Digital Senior Solutions Architect, who worked on and managed the 2.12 release. They are now completely independent from resources, which opens up possibilities for building brand new workflows > > ![Flexible file management -Then and Now](https://linkdigital.com.au/wp-content/uploads/2026/09/Flexible-file-management-Then-and-Now-1024x535.png "CKAN 2.12 File Management - Link Digital")*Then and Now: File Management* > > On top of this, the functionality is built in a backend-agnostic way. Whatever is implemented on one underlying storage, such as Google Drive, can switch effortlessly to another supported backend, such as AWS S3, a local file system, or a SQL database. ## **Faster downloads for large datasets** CKAN 2.12 introduces advanced filters for the DataStore API, enabling faster large dataset downloads and complex queries. > DataStore advanced filtering enables massive performance improvements for the DataStore dump interface, meaning much faster CSV downloads, said Ian Ward, another of our Senior Solutions Architects who worked extensively on CKAN 2.12. The end result is that it is faster and easier to work with data stored in CKAN. The new filtering feature dramatically speeds up exporting data to spreadsheet (CSV) files, even when the datasets are very large, by up to x15 times. A 13-million-record dataset used to take around 30 minutes to download and sometimes timed out. In CKAN 12.2, that same download takes about two minutes. This means you can do much more with CKAN’s basic out of the box functionality, without having to use specialist tools. The upgrade supports many queries that before 2.12 required datastore\_search\_sql – an advanced API endpoint for CKAN. This was an issue because some site owners don’t want SQL queries enabled. It also allows the deletion of multiple records, including ranges and logic operations, in a single API call. Many types of data searches previously required a separate, more advanced database query tool. From 2.12, you can run those searches through the standard interface instead. This matters because some organisations deliberately keep that advanced tool switched off for security reasons, and they no longer must give up those capabilities to stay secure. ![CKAN Keyset pagination-Then and Now](https://linkdigital.com.au/wp-content/uploads/2026/09/Keyset-pagination-Then-and-Now-1024x535.png "CKAN 2.12 Keyset Pagination - Link Digital")*Then and Now: Keyset Pagination* Key to increased speed is the work done on keyset pagination solution and dataset optimisation features. CKAN 2.12’s keyset pagination engine replaces legacy offset pagination by using record IDs as bookmarks. Rather than scanning millions of preceding rows, the database jumps directly to the target location. > This basically came out of [client’s feedback](https://linkdigital.com.au/case-studies/inter-american-development-bank-open-data-catalogue/#:~:text=open%20data%20portals.-,Million%20rows%20of%20data,-For%20example%2C%20the) regarding that they have issues with big files having 15 million records in them, said Yan Rudenko, CKAN Lead Developer at Link Digital. > > CKAN 2.12’s keyset pagination solution replaces legacy offset pagination by using record ID as bookmarks. Rather than scanning millions of preceding rows, the database jumps directly to the target location. This maintains constant iteration speeds across multi-million-record tables, resulting in faster downloads and eliminating export timeouts. ## **Easier bulk clean-up** CKAN 2.12 allows you to delete many records at once, including whole ranges or records that meet certain conditions, all in a single step rather than removing them one at a time. > This new filter interface is also a preview of a planned generic filter interface for searching across not only DataStore records but all the things CKAN stores, said Ward. This includes files, users, groups, organizations, datasets, activities, etc. > > ![Advanced DataStore Filtering](https://linkdigital.com.au/wp-content/uploads/2026/09/Advanced-DataStore-Filtering-now-1024x535.png "CKAN 2.12 Advanced DataStore Filtering - Link Digital")*The New Advanced DataStore Filtering* Advanced filters let you combine several conditions to pinpoint exactly the records you want. You can group conditions together and mix ‘all of these must be true’ (AND) with ‘any of these can be true’ (OR), including groups nested inside other groups for more detailed rules. You can also filter by number ranges, such as finding values that are below, above, or equal to a certain amount. The CKAN team has indicated that, in future, plugins will be able to add their own operations for any of the supported DataStore field types. [More information and examples related to this can be found here.](https://docs.ckan.org/en/2.12/maintaining/datastore.html#advanced-filters) ## **Front-end modernisation** CKAN 2.12 delivers a major front-end modernisation by embedding HTMX into its core architecture to replace heavy legacy JavaScript and jQuery pipelines with lightweight, hypermedia-driven interactions. The transition to HTMX dramatically reduces network payload sizes, cuts page latency, and lowers browser resource demands. Additionally, this modernisation introduces fresh default styling options, such as an opt-in Midnight Blue layout, and establishes the WCAG 2.2 accessibility foundation for the upcoming CKAN 3.0 theme update. Ward played a central role in this front-end evolution, spearheading the architectural adoption of HTMX, while Motornyuk and Rudenko supported the integration of HTMX fragments within file management workflows. ## **Security fixes and patch releases** Beyond the headline features, CKAN 2.12 itself includes numerous underlying security and architectural improvements that harden the platform. Alongside 2.12.0, the CKAN team also released updates for the older 2.11.x and 2.10.x versions that fix a number of security issues (including cross-site scripting and SQL injection). If left unaddressed, these issues could put a portal or its data at risk. Only the most recent update for each version includes these fixes, so older installations stay exposed until they are upgraded. If your portal runs on one of these versions, we recommend upgrading as soon as possible to keep it protected. This is also the final update for the 2.10.x version, which means it will receive no further security fixes, so moving to a newer version now is strongly recommended. **Examples of Security and Stability Dashboard** ![Examples of Security and Stability Dashboard](https://linkdigital.com.au/wp-content/uploads/2026/09/Examples-of-Security-and-Stability-Dashboard-1024x603.png "Examples of Security and Stability Dashboard - Link Digital") ## **Planning your upgrade?** CKAN 2.12 is the recommended stepping stone toward CKAN 3.0. If you would like help planning or performing your upgrade, get in touch with Link Digital: [linkdigital.com.au/get-in-touch](http://linkdigital.com.au/get-in-touch) **Categories:** All articles, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Industry, Internal data hub, Kate Sampher, Non-profit/NGO, Open Data, Technology Infrastructure, Thought Leadership **Tags:** CKAN, CKAN 2.12, CKAN upgrade --- ### [Introducing Link Digital's Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) **Published:** August 26, 2026 **Author:** Andrew Nette **Content:** It’s no secret that as the open data movement enters its third decade, traditional data platforms are dealing with a profound structural shift. For the past twenty years, open data portals operated primarily under a static storage model. Organisations collected data, structured it into standard tabular or geospatial formats, assigned basic administrative metadata, and uploaded it to public portals for humans to download and share. However, the exponential growth of machine learning (ML) and autonomous AI agents exposes vulnerabilities in these traditional repositories. When autonomous AI agents or ML models ingest raw data files that have been stripped of their original operational context, consent conditions, and creation intent, the risk of data drift, privacy violations, and model hallucinations increases dramatically. And without explicit, machine-readable provenance, modern AI models can end up training on unverified or altered inputs. [Link Digital](https://linkdigital.com.au/ "Link Digital") is working to improve this with the introduction of verifiable honesty – upgrading traditional data catalogues into active, verifiable data infrastructure tailored specifically for machine learning pipelines. Or, to put it another way, rather than asking users to trust the data from a system you cannot see into, a clear Statement of Intent is published up front, and what happens can be checked against it. This is the intent behind the Provenance Sandbox, an initiative being led by [Link Digital’s Executive Director Steven De Costa](http://linkedin.com/in/stevendecosta?originalSubdomain=au). > Once data is in and it has been used for machine learning, how would we correct things that might be completely wrong or bad? Steven said during a live demonstration of the Sandbox and the ideas behind it [at the most recent CKAN Monthly Live in August](https://ckan.org/events/the-provenance-sandbox-implementing-verifiable-honesty-for-ml-datasets-with-ckan-and-ooi). > If we can’t verify the lineage and intent behind our data, we’re building a future of AI on foundations of shifting sand. We might publish something right now and know the topology of it, but as things change, we won’t be able to hold onto it. Here’s a brief recap of Steven’s demonstration of the Sandbox and the stack behind it, which you can watch in full at the link below. ## **Moving beyond passive data storage** In traditional data management, open data portals function as passive storage endpoints. Data providers upload assets in various formats, alongside high-level descriptive tags. Downstream data consumers, including automated ETL (Extract, Load, and Transform) pipelines and ML systems, download the data under the implicit assumption that it is accurate, complete, and legally usable. But in an AI-driven environment, this model starts to experience problems. Large language models and predictive algorithms possess no intrinsic awareness of the organisation that generated a given dataset or the purpose for which it was developed. And they cannot inherently determine whether a dataset was compiled with strict regulatory consent, whether its fields were modified post-publication, or what operational hypothesis guided its collection. Steven discussed how the [Provenance Sandbox](https://mldata.opendata.ai/en/) can help meet these challenges. Rather than asking users to trust the data from a system they cannot see into, a clear Statement of Intent is published up front and integrated directed into the metadata model, and what happens can be checked against it. Instead of treating a dataset as an isolated and static artifact, datasets are wrapped in a continuous, machine-readable chain of evidence, changing data repositories from simple download distribution hubs into active infrastructure capable of participating in agentic workflows. > One of the key things that we really want to understand about data is, who stands behind it and how did it come to be and what does the data consent to? It’s consent from the custodian of the measurement, the thing that it was sampled from. If it’s a place, if it’s a time, how do you hold those things and how do you have the provenance available? ![Illustration of real world provenance sandbox with CKAN, OOI and ML datasets](https://linkdigital.com.au/wp-content/uploads/2026/08/3-Post-presentation-by-Steven_-Implementing-Verifiable-Honesty-1024x535.webp)## **The Provenance Sandbox stack** The architecture introduced by Steven combines open-source metadata standards, cryptographic logging, and runtime verification protocols layered directly over the core CKAN engine. ### ***Machine learning integration via MLCommons Croissant*** Data discovery adopts [Croissant](https://mlcommons.org/working-groups/data/croissant/), an open metadata standard developed under the umbrella of MLCommons. In the Provenance Sandbox architecture, MLCommons Croissant serves as the declarative discovery and structural layer for machine learning workflows. It provides: - A standardised metadata format (using JSON-LD) that describes what a dataset contains and how its columns, files, and resources are structured. It provides these in a standardised, machine-readable format for datasets, making datasets instantly discoverable and loadable by leading machine learning frameworks. - Direct Pipeline Ingestion: Datasets can be loaded directly into popular machine learning tools and frameworks without requiring custom ingestion scripts. But while Croissant solves the structural ingestion problem – explaining *how* a dataset is formatted and *where* its columns map – it does not inherently evaluate the operational rules, business logic, or goal-setting criteria that governed the data’s production. ### ***Goal-setting logic via the Objective Observer Initiative*** To address the operational logic missing from standard metadata formats, the Provenance Sandbox introduces a framework being developed as part of another capability Link Digital is working on, the Objective Observer Initiative (OOI). This establishes three distinct functional domains: - This domain captures the initial Statement of Intent, the explicit grant, scope, intended utility, and legal constraints agreed upon by data creators during collaborative phases. - It anchors transformation scripts, processing algorithms, and model parameters directly to the declared intent. - It captures the observer experience, acting as an automated observer, recording live execution outputs, verifying schema integrity, and publishing state registries back to the data portal. The OOI has the potential “to transform abstract AI ethics into machine readable, verifiable records of trust,” said Steven. The idea of what trust is is kind of a synthetic agreement. How we agree about how we are going to operate in civic contexts, in social norms is very difficult to adjudicate and find justice in unless that synthetic agreement is somehow tangible, somehow constructed and readable. And, if we are going to be using a lot of AI, and supporting technologies, it really has to be machine readable and actionable as well.” While Croissant handles data discovery and structural description for ML engineers, it acts as a complement to the OOI. Croissant defines the dataset’s layout for machines, whereas OOI defines the prior goal-setting logic, operational rules, and ‘game’ behind the data. ### ***CKAN as the readable surface for the data*** The [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN) is used as the foundational data catalogue and storage layer. CKAN acts as the physical repository where the raw data files, datasets, and initial resources are uploaded, stored, and managed, and provides the portal user experience, search features, access controls, and API endpoints that allow users and applications to browse, discover, and download datasets. “CKAN is actually a really cool tool for doing this,” De Costa maintained. “It has a lot of features. It is very API happy to work with other tools.” Rather than replacing CKAN, the Provenance Sandbox extends it. CKAN acts as the reliable storage core, while the external frameworks (MLCommons Croissant for structural ML schemas and OOI for intention sealing/witnessing) layer on top to turn CKAN from a passive repository into active ML infrastructure. Also to read:[*The Objective Observer Initiative and the challenge of being fully open*](https://linkdigital.com.au/news/2026/02/the-objective-observer-initiative-and-the-challenge-of-being-fully-open/) ![An illustration of the Objective Observer Initiative as the outcome of verifiable integrity within CKAN](https://linkdigital.com.au/wp-content/uploads/2026/08/2-Post-presentation-by-Steven_-Implementing-Verifiable-Honesty-1024x535.webp)## **Establishing verifiable trust in the AI era** The architecture takes a different approach to guaranteeing data integrity. Rather than checking for data tampering after a dataset has already been processed, the system anchors parameters *before* computational runs take place: - A data steward or automated pipeline registers a Statement of Intent outlining the experimental design, geographic boundaries, and processing constraints. - The declared parameters, raw source references, and transformation scripts are hashed, locking the initial state into the platform’s ledger. - As live transformations run, the OOI observer continuously conducts ‘witness checks,’ testing runtime outputs against the sealed parameters. - If incoming data points deviate from the declared parameters – due to sensor drift, code changes, or altered upstream sources – the deviation is not silently overwritten. Instead, the drift is appended to an immutable, PROV-O compliant ledger. > We have to create data that is for the dynamics that we want to improve,” Steven said. “That’s where I’m starting. I am starting before the data, with the statement of intent. And I am saying… Croissant is the standard way to express that at the moment doing R&D in this space. The aim is to replace subjective assumptions about data reliability with objective proof. Rather than asking whether a dataset is abstractly accurate, machine learning models can verify whether the dataset strictly conforms to its witnessed lineage and declared purpose. The transition from static data portals to active, verifiable infrastructure represents a vital evolution for open data ecosystems. As automated tools, autonomous agents, and machine learning models become the primary consumers of public data, traditional metadata tagging models are no longer sufficient to guarantee data safety, attribution, and reliability. > Working in this way allows you to know what is verifiably honest… The records really matter. They come through a process that has a declared intent at the start, so an identifying entity. It operates authentically to that identity and, as it operates, it encodes itself. It makes itself observable, communicable and effectual, and it leaves records that are also observable, communicable and effectual. Steven finished his demonstration with a call to the open-data community to move away from passive data consumption and actively participate in building active, verifiable infrastructure. > Creating the right data sets for the right future of AI is a big responsibility. And I think we really have to try and catch that responsibility and hold onto it. He stressed that the Sandbox is open to “folks wanting to do other stuff, working with data sets that can be more actionable, ready for machine learning, ready for some of these challenges that we are facing. Let us know if you want to play with it. If you want an account.” If you want to know more, you can watch Steven’s Provenance Sandbox demonstration, including a potential use case example and the discussion that followed it,[ on our YouTube site here](https://www.youtube.com/watch?v=wuGgJMtr4bs). [You can also download Steven’s presentation here](https://linkdigital.com.au/wp-content/uploads/2026/08/The-Provenance-Sandbox-The-OOI-Experiment-Link-Digital.pdf). [If you are looking to participate in this experiment, you can join by simply registering here](https://linkdigital.com.au/link-lab/) **Categories:** All articles, Artificial Intelligence, CKAN, Digital Public Infrastructure, Internal data hub, Objective Observe Initiative, Open Data **Tags:** CKAN, MLCommons Croissant, Objective Observer Initiative, Provenance Sandbox, verifiable honesty --- ### [When the visitors aren't human: What rising bot traffic means for your data portal](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) **Published:** August 19, 2026 **Author:** Kate Sampher **Excerpt:** This guide explains bot traffic trends, who runs the bots, and how portal owners can balance discoverability with robust defenses. **Content:** Over the past several months we have watched a clear shift in the traffic reaching the sites and portals we work with. A growing share of it is not coming from people. It’s coming from bots. At first glance, an uptick in activity can look like growing interest. But a closer look reveals much of it is automated: crawlers, scrapers, and AI agents moving across the web at a scale that now outpaces human visitors. [Link Digital ](http://linkdigital.com.au)believes it is important to be open with its clients about what is happening, why it is happening, and what it means for the portals your operations rely on. ## **What is happening?** In 2025, automated traffic on the web grew far faster than human activity, as more people turned to AI assistants for everyday questions. [By 2026, bots had, for the first time, become the majority of web requests.](https://blog.cloudflare.com/agentic-internet-bot-report/) The web was built on the assumption that a person sits on the other side of the screen. That assumption is increasingly not the case. ## **Why it is happening** Most of this traffic relates to AI activity, and it falls into three patterns: - **Training crawlers** that gather content to build and update AI models - **Real-time fetchers** that pull a page when someone asks an AI assistant a question - **Agentic browsers** that navigate sites on a user’s behalf ![Infographic: Automated traffic is outpacing humans, with AI daily requests on the left and bots’ share of web traffic on the right.](https://linkdigital.com.au/wp-content/uploads/2026/08/Automated-traffic-is-outpacing-humans-1024x535.png) A lot of the traffic comes from a small number of operators. According to [HUMAN Security’s 2026 State of AI Traffic report](https://www.humansecurity.com/learn/resources/2026-state-of-ai-traffic-cyberthreat-benchmarks/), OpenAI’s bots account for roughly 69% of observed AI-driven traffic by volume, Meta around 16%, and Anthropic around 11%. These figures vary by measurement method and period, so treat them as directional, but the pattern of concentration is consistent across all the sources. One aspect of this that is worth stating plainly is that the heaviest AI traffic lands on retail, media, and travel sites, which together absorb more than 95% of it. Government, research, and open-data portals may see a different pattern, which is why your own server logs, not industry averages, are the most reliable measure of your exposure. ## **Why this matters for portal owners** There are two practical consequences. First, measurement. Standard analytics tools often cannot tell an AI agent from a human user, so raw visit counts are no longer a clean signal of genuine human interest. Engagement depth and authenticated actions are more dependable signals. Second, infrastructure. Bots consume real resources: bandwidth, compute, and server capacity. AI bots drive increased scraping, operational load, and high-frequency access, and at scale that can translate into infrastructure cost, particularly for organisations running a public data portal. ## **What you can do about it** The good news is that this is a manageable problem. Much of this traffic is legitimate, and, for open data, research, and government portals, being discoverable is usually the point. The goal is to let the useful visitors in, slow down the heavy ones, and keep out the genuinely abusive ones, without losing visibility or overspending on capacity. In practice, this means: - **Measure what matters.** Lean on engagement depth, authenticated actions, and qualified enquiries rather than raw visit counts, and review your server logs to see which bots are actually hitting you. - **Decide who you let in.** You can set the rules for crawlers with a small file on your site called [robots.txt,](https://en.wikipedia.org/wiki/Robots.txt) which tells them what they can and cannot access. The catch is that it works on trust: well-behaved crawlers, like search engines, follow those rules, but abusive ones ignore them. So robots.txt takes care of the polite bots, while the heavy crawlers can be slowed down with rate-limiting (a cap on how often they hit your server), and the genuinely abusive ones can be blocked outright. Done this way, your portal stays discoverable without the load getting out of hand. - **Protect the infrastructure.** A few standard tools can take most of the strain off your server. Caching and a CDN (a content delivery network) keep copies of your pages so repeat requests do not hit your main server every time. Server-side rate-limiting and a web application firewall (WAF) give you enforceable control that bots cannot simply ignore, unlike robots.txt. And bot-management tooling spots and handles automated traffic at scale. [![Bot traffic readiness checklist](https://linkdigital.com.au/wp-content/uploads/2026/08/Bot-Traffic-Readiness-Checklist-724x1024.png)](https://linkdigital.com.au/wp-content/uploads/2026/08/Bot-Traffic-Readiness-Checklist.pdf) **Free download:** Grab our [Bot Traffic Readiness Checklist,](https://linkdigital.com.au/wp-content/uploads/2026/08/Bot-Traffic-Readiness-Checklist.pdf) a one-page guide portal owners can work through step by step. ## **Planning for capacity and cost** This is the part of the issue Link Digital wants to be candid about. As automated traffic grows, some portals will need more infrastructure headroom to stay fast and reliable, and that can mean a future conversation about capacity and budget. We want to flag it earlier rather than later. Right now, Link Digital is not introducing new charges related to what we are talking about in this article. Instead, we are working through how best to manage the additional costs, resources, and expertise involved so that any infrastructure decisions are planned together with clients, based on evidence from your own traffic, rather than being sprung on you unilaterally. ## **How we can help** If you would rather not manage any of these tasks in-house, that is exactly what our [managed hosting service is for.](https://linkdigital.com.au/services/managed-hosting/) We handle the caching, rate limiting, monitoring, and bot management on your behalf and keep you informed on how your portal traffic is trending. You stay focused on your data and your users; we keep the infrastructure steady underneath. If you would like a quick review of what bot traffic currently looks like on your portal, we are happy to look at your logs and talk you through it. [Contact us here if you would like to discuss your situation and what might be involved.](https://linkdigital.com.au/get-in-touch/) Sources: - [Agentic internet bot report](https://blog.cloudflare.com/agentic-internet-bot-report/) - [NBC News: bots have passed human activities online](https://www.nbcnews.com/tech/tech-news/bot-web-traffic-overtaken-human-web-traffic-data-shows-rcna348522) - [Imperva / Thales, Bad Bot Report 2026: bot share of global web traffic](https://www.imperva.com/blog/bad-bot-report-2026-bots-agentic-age/) - [HUMAN, 2026 State of AI Traffic report: growth in AI-driven and agent-driven traffic](https://www.humansecurity.com/learn/resources/2026-state-of-ai-traffic-cyberthreat-benchmarks/) **Categories:** All articles, CKAN, Internal data hub, Kate Sampher, Open Data, Technology Infrastructure **Tags:** CKAN, data portal --- ### [Link Digital cements new Canadian strategic collaboration](https://linkdigital.com.au/news/2026/06/link-digital-cements-new-canadian-strategic-collaboration/) **Published:** June 3, 2026 **Author:** Kate Sampher **Content:** *This article is co-authored by François William Croteau, President and CEO at IRIU.* [Link ](https://linkdigital.com.au/)[Digital](https://linkdigital.com.au/) has signed a strategic collaboration with the [Institut de la Résilience et de l’Innovation Urbaine](https://www.iriu.ca/) (Institute of Urban Resilience and Innovation – IRIU), a prominent not-for-profit organisation based in Montreal, Canada. The agreement brings together the considerable strengths of two leading players in the Canadian open data scene: IRIU’s experience in AI-ready data hubs and digital capacity building to improve urban resilience and sustainable living in areas such as climate adaptation and flooding; and Link Digitals’ global expertise building and maintaining open source, open data infrastructure using the [Comprehensive Knowledge Archive Network](https://ckan.org/). “This is an extremely exciting development,” said Scott Lingard, Link Digital’s Chief Revenue Officer. “Not only are our skills complementary but Link Digital and IRIU share a common ethos of support for the value of making data open, the need for efficient open source digital infrastructure, the ethical development of AI, and the importance of data sovereignty.” The collaboration agreement also promises to further increase Link Digital’s presence in the Canadian open data ecosystem. The collaboration will see Link Digital – a co-steward of the CKAN software – act as the technical partner in future IRIU projects with Canadian government agencies, local governments and community stakeholders, focused on developing strategies to meet future environmental challenges and improve the quality of life for citizens. Link Digital established its Canadian subsidiary in 2023, where it operates under the registered Canadian business name Datashades Ltd**.**, with its office based out of Toronto, Ontario. --- ## Link Digital consolide une nouvelle collaboration stratégique canadienne [Link Digital](https://linkdigital.com.au/ "Link Digital") a signé une collaboration stratégique avec [l’Institut de la Résilience et de l’Innovation Urbaine ](https://www.iriu.ca/ "l’Institut de la Résilience et de l’Innovation Urbaine ")(IRIU), un organisme à but non lucratif de premier plan basé à Montréal, au Canada. L’accord rassemble les forces considérables de deux acteurs majeurs de la scène des données ouvertes au Canada : l’expérience de l’IRIU dans les centres de données prêts pour l’IA et le renforcement des capacités numériques visant à améliorer la résilience urbaine et le mode de vie durable dans des domaines tels que l’adaptation climatique et les inondations; et l’expertise mondiale de Link Digital dans la construction et la maintenance d’infrastructures de données ouvertes et de sources ouvertes utilisant le [Comprehensive Knowledge Archive Network](https://ckan.org/ "Comprehensive Knowledge Archive Network"). “Il s’agit d’une évolution extrêmement passionnante”, a déclaré Scott Lingard, Chef des revenus de Link Digital. “ Non seulement nos compétences sont complémentaires, mais Link Digital et l’IRIU partagent une éthique commune de soutien à la valeur de l’ouverture des données, à la nécessité d’une infrastructure numérique open source efficace, au développement éthique de l’IA et à l’importance de la souveraineté des données.” L’accord de collaboration promet également d’accroître davantage la présence de Link Digital dans l’écosystème canadien des données ouvertes. La collaboration verra Link Digital – co-gérant du logiciel CKAN – agir comme partenaire technique dans les futurs projets de l’IRIU avec les agences gouvernementales canadiennes, les gouvernements locaux et les parties prenantes communautaires, en se concentrant sur le développement de stratégies pour relever les futurs défis environnementaux et améliorer la qualité de vie des citoyens. Link Digital a établi sa filiale canadienne en 2023, où elle opère sous le nom commercial canadien enregistré Datashades Ltd., avec son bureau basé à Toronto, en Ontario. **Categories:** All articles, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Environmental/Climate Change, Open Data, Technology Infrastructure, Topics **Tags:** CKAN, climate resilience, Institute of Urban Resilience and Innovation, open data --- ### [From open data to verifiable honesty: An experiment you can look at](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) **Published:** August 12, 2026 **Author:** Kate Sampher **Content:** For many years the promise of open data was simple: make your data public, make it shareable, and good things follow. I still believe this. But the question now is, can you trust the data and the sources it came from? We are surrounded now by so much content that looks credible but is not. AI can produce a confident answer from a source that, in many cases, no one can check or verify. To cite one example of the impact of this, of the more than 1,600 biomedical researchers from 80 countries that took part in a [2024 international survey](https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3002870), 72% agreed their field faces a crisis because many published study results cannot be independently verified or repeated. The problem is not that we lack data. It is that we cannot verify and, hence, trust a lot of it. At [Link Digital,](http://linkdigital.com.au) we are working towards verifiable honesty. This means that, rather than asking you to trust the data from a system you cannot see into, a clear statement of intent is published up front, and what actually happens can be checked against it. To see it live, we are running a [CKAN instance as a provenance sandbox](https://mldata.opendata.ai/en/), where experiments are published as datasets, each carrying their intent and an external witness. One record is a position. Two agreeing records are a knowing. For anyone who runs a CKAN portal, it is a glimpse of what the platform can hold beyond the data itself: the record of how that data came to be. I want to be honest about where the project sits, because honesty is the whole point. It is an early experiment. The doors are open to look and open to join. This is related to a project Link Digital is participating in called the [Objective Observer Initiative.](https://linkdigital.com.au/news/2026/02/the-objective-observer-initiative-and-the-challenge-of-being-fully-open/) We will walk through the sandbox live at [CKAN Monthly Live on 19 August,](https://ckan.org/events/the-provenance-sandbox-implementing-verifiable-honesty-for-ml-datasets-with-ckan-and-ooi) so if you want to see how it works on a real portal, please join us. And if the idea of a portal that holds not just data but the accountability trail around it interests you, come and explore and [register your interest through Link Lab.](https://linkdigital.com.au/link-lab/) **Categories:** All articles, CKAN, Industry, Objective Observe Initiative, Technology Infrastructure **Tags:** CKAN, Digital public infrastructure, open source --- ### [Debates in open source: Observations from UN Open Source Week 2026](https://linkdigital.com.au/news/2026/07/debates-in-open-source-observations-from-un-open-source-week-2026/) **Published:** July 13, 2026 **Author:** Andrew Nette **Content:** ![Collage-style banner with United Nations logo, 'Open Source Week' text, and LINKDIGITAL branding in blue, with geometric shapes.](https://linkdigital.com.au/wp-content/uploads/2026/07/UN-Open-Source-Week-1024x535.webp) [Open Source Week ](https://www.unopensource.org/)[2026](https://www.unopensource.org/) took place in the United Nations headquarters in New York in late June. Among the attendees at the five-day conference, one of the premier global forums aimed at advancing open source technology, AI, digital public infrastructure and their potential role in advancing the [UN’s Global Development Goals](https://sdgs.un.org/goals), was [Link Digital’s Senior Solutions Architect, Ian Ward](https://www.linkedin.com/in/ianward/). Ian joined representatives from UN agencies, governments, tech companies, not for profits, civil society and the open source technical community. “The broad variety of perspectives was one of the best aspects of the event,” he says. In addition to being present at all the major conference streams, Ian was also a panellist during one of the major side events, a series of discussions on ‘Democratizing AI: Ethics, Sovereignty, and Inclusive Ecosystems’. Let’s briefly recap some of his key impressions from the event. ## Open source: the backbone of digital infrastructure As was the case last year, a key theme of the conference was the role of open source technology in the creation of digital public infrastructure (DPI), core digital systems that enable governments to function better and ensure that people, organisations and governments can interact, exchange information and access services securely and easily. “Open Source is the backbone of DPI, because it’s open and equally available to small countries as large ones. Instead of each government developing their own systems they can reuse existing DPIs.” Conference participants confirmed the value of DPIs, including improving access to government services, reduced bureaucracy, and significant financial savings to governments. DPIs also play a role in support of the UN’s Sustainable Development Goals by acting as a sustainable digital public good (DPG) and open data infrastructure for countries and grassroots civil society movements who may lack the means to establish and maintain one on their own. It can be used to create digital platforms on which any government, donor, academic, or member of the community can both store and access high quality and reliable data to guide decision making and action. “Sovereign DPI is built on DPGs, and DPGs are open source projects recognised as the best in terms of community engagement, support, security and longevity. Open source offers reusable components instead of one-off systems, interoperability instead of vendor lock-in and lower cost and faster deployment by sharing the maintenance burden.” Another practical example that Ian gave for how open source tech is helping meet the Sustainable Development Goals is platforms like the UN’s [Humanitarian Data Exchange (HDX)](https://data.humdata.org/). Managed by the UN [Office for the Coordination of Humanitarian Affairs](https://www.unocha.org/), the HDX is an open data-sharing platform that collects and organises thousands of crisis-specific datasets from sources around the globe and makes this data more easily discoverable and accessible, ultimately accelerating emergency response and saving lives during global crises. The HDX is powered by CKAN, which has been customised to meet humanitarian requirements. “The UN’s Humanitarian Data Exchange (HDX) was an easy point of reference at the conference,” notes Ian. Most people I spoke to use the data it publishes with CKAN, even if they aren’t aware of the technology running underneath. The HDX team’s publications, contributions, and extensions are a real asset to the CKAN community.” Also to read: [*Planning your data infrastructure: The benefits of open source compared to proprietary software*](https://linkdigital.com.au/news/2026/03/benefits-of-open-source-compared-to-proprietary-software/) ![A discussion on Open Source and Digital Sovereignty in a Connected World. Photo by Ian Ward.](https://linkdigital.com.au/wp-content/uploads/2026/07/Open-Source-image-1-1024x771.jpg)A discussion on Open Source and Digital Sovereignty in a Connected World, June 2026, New York City. Photo by Ian Ward. ## Sustainability and maintenance of open source public goods One of the major debates at the conference was the question of what support governments can get for using open source applications, the vendor support ecosystem and how can DPI based on open source technology be made more sustainable over the long term. “Maintenance was a major topic. Some successes, like Drupal foundation’s model for recognising contributions, were presented but there is no one formula that solves the problem of paying for the work that keeps OS projects functioning. Open Source governance and community engagement were also frequently discussed. “Open Source Program Offices were recognised as a major part of the solution. They are a centre of excellence for interacting and contributing to open source projects on which government and private sector organisations rely. It’s not enough to change procurement policy, organisations need to lean in and support the projects they use with direct contributions to their communities.” The maintenance issue is linked to a much wider debate as to whether users of open source software should not just free ride but also contribute to its creation and upkeep. This is, in turn, linked to ongoing concerns about whether critical open source software is receiving adequate, sustained attention and development resources, so they can remain robust and reliable. Also to read: [*What is the true value of open source software? It depends on what you’re measuring*](https://linkdigital.com.au/news/2025/03/what-is-the-true-value-of-open-source-software-it-depends-on-what-youre-measuring/) ## Open source technology and AI Last year’s Open Source Week saw major discussion on AI and open source, with many participants stressing that open source is a democratising force in AI, that can foster transparency and accelerates collaboration. These discussions continued at the 2026 event. “Ethical AI use was another major topic, with some voices pushing to embrace the hyperscalers and others championing a more nuanced approach, recognising limitations and opportunities in various models.” “Open source AI models also mean that AI capacity won’t be concentrated in wealthy countries,” stresses Ian. These models offer the possibility of democratising the technology for poorer countries. Discussions also took place about how to ensure AI is developed and governed in an ethical and inclusive way, that leads to a narrowing of the digital divide rather than increasing it. “My panel discussed the meeting of AI tools and data publishing. We covered ethical practices and how to ensure the reliability and provenance of data and answers shared with the public. CKAN’s role in capturing, sharing and even generating this important metadata featured prominently. There is real excitement around efforts to improve and share metadata standards. I was approached by several people after the panel and hope to have more to announce soon.” ## Want to build a CKAN-based open or internal data portal? [Contact us](https://linkdigital.com.au/get-in-touch/) and one of our data experts will be in touch. **Categories:** All articles, Artificial Intelligence, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Government, Higher Education/Research, Non-profit/NGO, Open Data **Tags:** CKAN, data portal, Digital public infrastructure, Open source technology, UN Open Source Week --- ### [Making the move to managed CKAN hosting: How it worked for the Columbia Basin Water Hub](https://linkdigital.com.au/news/2026/07/making-the-move-to-managed-ckan-hosting-how-it-worked-for-the-columbia-basin-water-hub/) **Published:** July 22, 2026 **Author:** Andrew Nette **Excerpt:** What are the benefits of managed CKAN hosting? This is the experience of an organisation that transitioned its data portal to fully managed hosting with Link Digital. **Content:** The [Comprehensive Knowledge Archive Network](https://ckan.org/) – CKAN – is the world’s leading open source data portal software. While it is free and has native out of the box functionality, setting up and running larger and more complex CKAN instances can be difficult. This is where managed CKAN hosting comes into the picture. Managed CKAN hosting is a service where a third-party vendor handles all the technical heavy lifting – server setup, maintenance, security, updates, and scaling – allowing your organisation to focus purely on managing and sharing data. A practical illustration of the benefits of managed hosting can be found in the [Columbia Basin Water Hub](https://livinglakescanada.ca/project/columbia-basin-water-hub/), a centralised online repository for water data collected from across the Columbia Basin, North America’s fourth largest freshwater basin. Run by [Living Lakes Canada](https://livinglakescanada.ca/), the Hub is a charitable, non-governmental organisation focused on water stewardship, with over 20 years of experience working with community groups to protect freshwater. Developed with the assistance of Link Digital using CKAN and launched in 2021, the Hub is designed to store past, current and future water data, ensure adequate quality control and make the data more accessible and shareable. Link Digital recently transitioned the Hub to a fully managed CKAN hosting solution. [Maggie Finkle-Aucoin](https://livinglakescanada.ca/profile/team/maggie-finkle-aucoin/), GIS and Database Manager at Living Lakes and manager of the Hub, talked to us about what this involved in the move and what the benefits have been. ![Security-first with managed hosting inclusions](https://linkdigital.com.au/wp-content/uploads/2026/07/2-Managed-hosting-security-first-1024x717.jpg)## **Why the switch to managed hosting?** Several internal resource issues and pain points led the Hub team to switch to CKAN-managed hosting. When the Hub was first established, Living Lakes Canada partnered with two other organisations that were also working towards water data monitoring goals, and the Hub was hosted on one of their servers. “So, we did have some additional support there, but it was largely still our responsibility to oversee that hosting environment and deal with the occasional bugs or issues that were propping up,” says Finkle-Aucoin. “And within the Columbia Basin Water Hub team and within Living Lights Canada, we don’t have a ton of capacity when it does come to IT and digital services.” While Living Lakes had been mulling over the decision to switch to a managed hosting service for a couple of years, the turning point was an incident where the Hub became overrun with bot activity. “Speaking with the Link Digital staff, we discovered that it was some sort of model training itself on the water Hub, and it slowed the service down to the point where the Hub was no longer functioning.” “And despite our best efforts, doing what we could with our skill set to manage that kind of traffic of bots, we just couldn’t get around it. At that point, it was really clear we needed to make that change from a security standpoint as well.” Living Lakes staff worked closely with Link Digital’s Canadian subsidiary, Datashades Ltd, and we were able to put extra security in place, which eliminated the bot problem. “To be honest, I think something that I had internalised a little bit was feeling this was going to be a really big job,” admits Finkle-Aucoin. “But your team made it so straightforward. For us it was just a matter of kicking off that process with Link Digital and moving that service over, giving Link Digital the proper permissions and then having it over there.” “On our end there wasn’t much change that had to be done, and primarily now it’s just a matter of being more confident and comfortable in the kind of hosting environment that we have and rewriting some of our protocols which result in a bit less work on our end.” Also to read: [*Why CKAN Managed Hosting Matters (and how to get it right)*](https://linkdigital.com.au/news/2025/06/why-ckan-managed-hosting-matters-and-how-to-get-it-right/) ## **Benefits of managed hosting** According to Finkle-Aucoin, managed CKAN hosting has had several other benefits. The Hub’s future plans include talking to groups in watershed areas outside the Columbia Basin about setting up their own data portals and helping to facilitate those kinds of builds. Until now, storage has been a prohibiting factor in making this happen. “There was a limit, a ceiling that we had with our last \[hosting\] provider. And now being with Link Digital and being on this new managed service, the storage component is no longer a concern.” “It also gives us a lot more confidence and trust in the infrastructure that is running the Hub. Obtaining more data is also one of the things that typically slow the repository down… But within the new platform, things are not slowing down in the way that we would have seen on our previous service.” Also to read: [*How CKAN supports community-based water monitoring in Canada’s Columbia Basin Watershed*](https://linkdigital.com.au/news/2025/09/how-ckan-supports-community-based-water-monitoring-in-canadas-columbia-basin-watershed/) Living Lakes currently works with more than fifty groups actively collecting data on water quality or quantity, these include First Nations communities. This takes place within the framework of [the OCAP Principles](https://fnigc.ca/ocap-training/) – ownership, control, access, and possession – which are designed to protect Indigenous ownership, control, and stewardship of their data. Managed hosting has helped with this work by providing more sophisticated access controls and security protocols necessary to respect indigenous data ownership. “Being with Link Digital and being on this managed server gives us a little bit more control over the data storage and allows us to enact some of the protocols when it comes to deletion protocols and secure data storage. I definitely see how this move has enabled us to improve our ability to offer indigenous communities, First Nation governments, and then also just our other communities who are concerned about their data security, a better space to host their data.” Finkle-Aucoin lists several other indicators that Living Lakes staff will be looking at to measure the success of the move to managed hosting. “One of the first ones that come to mind is the reduction in bot traffic on the Hub. We’re not seeing an interruption to service. We’re not having users experience an issue where the hub is slow or lagging. In fact, it’s the snappiest it’s ever been.” “We’re constantly in chat with our data contributors and our data users. So, we’ll be looking to them to kind of hear their feedback about any issues that they’ve experienced with the transition. So far, it’s been nothing but positive.” “And then in terms of cost savings, we will continue to kind of monitor that, but we’re already seeing a reduction in time that we need on our end internally. So, this again looks like another success point for us.” ## Want to talk about transitioning your CKAN portal to a fully managed service? [Link Digital’s CKAN experts are ready to help you.](https://linkdigital.com.au/get-in-touch/) You can [watch the full interview with Maggie Finkle-Aucoin](https://www.youtube.com/watch?v=L6MNeakoyoc) about the Columbia Basin Water Hub’s transition to a fully managed CKAN hosting service on our YouTube channel here. --- **Categories:** All articles, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Government, Higher Education/Research, Industry, Internal data hub, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** CKAN, Living Lakes Canada, Managed CKAN hosting --- ### [Getting ahead of the deadline to upgrade your Drupal capability](https://linkdigital.com.au/news/2026/08/getting-ahead-of-the-deadline-to-upgrade-your-drupal-capability/) **Published:** August 6, 2026 **Author:** Andrew Nette **Excerpt:** Running an older Drupal version? It needs updating by the end of 2026 to ensure it continues to function smoothly and securely. Link Digital can help. **Content:** While the [Comprehensive Knowledge Archive Network or CKAN](https://linkdigital.com.au/ckan/) is vital to Link Digital’s work on data catalogues and open data platforms, we often use it with another piece of open source technology – [Drupal](https://linkdigital.com.au/drupal/). CKAN can be configured and set up to function as a data catalogue or open data platform, while Drupal is deployed to help manage and present large data repositories in an attractive, interactive and user-friendly way. But while it is stable and secure, like any digital platform, Drupal has a release cycle, and 2026 is a pivotal year for anyone still running older versions. These need to be updated by the end of this year to ensure that they continue to function smoothly and securely. Yan Rudenko is Link Digital’s CKAN Lead Developer. In addition, he also has a decade of Drupal experience, starting from version 7 of the software. I talked to him about Drupal’s capabilities and why the remaining months until December 2026 are an important time for those who use the software. ## **The benefits of Drupal** “Drupal is a powerful and flexible content management system that allows for easy creation and management of content,” says Yan. “It is also a secure and scalable platform that can be used to build a variety of websites and applications.” “Many organisations now build websites with AI tools, using popular prompts and technologies based on Javascript frameworks. But they don’t consider a lot of aspects that Drupal can deliver out of the box, especially when it comes to long-term maintenance and scalability.” While Drupal and CKAN can be used separately in applications that manage and publish data, Link Digital often uses them together, as they reinforce each other’s strengths. CKAN performs the backend functions of storing and cataloguing data, as well as developing detailed metadata, while Drupal serves as the front-facing user management system. Organisations can utilise Drupal’s flexible theming and content management structure to create visually engaging web applications, enhancing the presentation of the data and creating a far more interactive, content-rich and attractive web user experience. While Drupal can be used on its own to store, edit and display datasets as content, Yan maintains this only works for small, curated lists or marketing “featured datasets”. Drupal is weak for full catalogue scale data portals that require harvesting capabilities, resource formats, datastore, and API consumption, etc. “When switching to Drupal and CKAN, users should expect a platform that is powerful, flexible, and easy to use. Especially when there is a split of responsibilities between those responsible for different aspects of the website. It is important to have a platform that is easy to use and understand.” Also to read on our site: [*Why organisations should use it as part of their data management*](https://linkdigital.com.au/news/2024/10/drupal-why-organisations-should-use-it-as-part-of-their-open-data-management/) ## **Why Drupal users need to upgrade** The next five months are vital for anyone running older versions of Drupal. After 14 years of service, [Drupal 7 reached its official end of life on 5 January 2025](https://www.drupal.org/about/announcements/blog/drupal-7-has-reached-end-of-life-psa-2025-01-06), and the Drupal Security Team is no longer releasing security advisories, patches, or compatibility updates for it. This means that if you are still running Drupal 7, your site will be subject to serious issues. And for organisations subject to legal compliance frameworks, running unsupported software can create not only security problems, but compliance liabilities. Drupal 10 will reach end of life on 9 December 2026, with Drupal currently targeting the release of Drupal 12 for the same time. There is no direct upgrade path from Drupal 7 to the most up to date version of Drupal. Moving forward means rebuilding the site on the latest Drupal codebase, migrating your content, and reimplementing custom functionality. “Each major release version of Drupal reworks or improves existing code, which leads to big changes that cannot be just added to Drupal 10, this involves new features and better security due to reworks. This is why it is important to upgrade to the latest version of Drupal as soon as possible.” This means the jump from 10 to 11 is far more manageable than a Drupal 7 migration. Drupal 10 and 11 share a continuous upgrade path, provided your site is on Drupal 10.3.0 or later release, and provided your contributed modules and themes already have Drupal 11 compatible releases in place. Even for those existing sites that are up to date, a Drupal 12 upgrade is probably not feasible until at least early 2027. Yan stresses that the stakes of being caught on the wrong side of an end-of-life deadline for your version of Drupal are high. “Each version of Drupal is not only about adding new features and improvements. It also adds security improvements for the end users, which are crucial for the long term maintenance and scalability of the website.” “If organisations do not upgrade to Drupal 11 before December 9, they will face a number of challenges. They will not be able to use the latest features and improvements of Drupal 11, including not being able to use the latest security patches and updates. They will also be unable to use the latest documentation and support resources or the latest community and ecosystem resources. This is important because it will be difficult to find help and support if they need it.” ![Drupal 10 vs Drupal 11 Requirements Comparison - Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/08/Drupal-10-vs-Drupal-11-Requirements-Comparison-1024x535.jpg)*Drupal 10 vs Drupal 11 Requirements Comparison* ## Getting ahead of the deadline to upgrade your Drupal capability Link Digital has been delivering Drupal development for government agencies, universities, and international organisations for more than two decades, and can help your organisation get ahead of the deadline to upgrade your Drupal capability. If you’re weighing up a Drupal 7 rebuild or a Drupal 10 to 11 upgrade, [message Link Digital](https://linkdigital.com.au/get-in-touch/) today to talk through your options and to deliver a migration plan that can get you ahead of capability deadlines. **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Government, Higher Education/Research, Internal data hub, Non-profit/NGO, Open Data, Technology Infrastructure **Tags:** Drupal, Drupal ugrade --- ### [Why CKAN Managed Hosting Matters (And how to get it right)](https://linkdigital.com.au/news/2025/06/why-ckan-managed-hosting-matters-and-how-to-get-it-right/) **Published:** June 19, 2025 **Author:** Kate Sampher **Excerpt:** Behind every high-performing CKAN site is something less visible but equally important: reliable, secure, and well-managed hosting. Read more to know Why managed hosting is your behind-the-scenes power tool. **Content:** *This blog post is co-authored with Joel Wigley, Systems Operations Team Lead at Link Digital* --- Running a CKAN – [Comprehensive Knowledge Archive Network](https://ckan.org/) – portal comes with responsibilities, for the data you host and for your users and the trust they place in your platform. But while your focus is on publishing datasets, improving metadata, or enabling collaboration across departments, the day-to-day demands of infrastructure management often slip under the radar. Behind every high-performing CKAN site is something less visible but equally important: reliable, secure, and well-managed hosting. ## **Hosting is strategy; not just storage** It’s easy to think of hosting as just storage. But for teams managing open data portals, especially in government, research, or NGO settings, uptime, security, and performance aren’t optional. They’re mission-critical. That’s where managed hosting enters the picture. Imagine not having to worry about server downtime, failed security patches, or sluggish performance when thousands of users hit your portal at once. With the right hosting partner, you don’t have to. ## **Why managed hosting is your behind-the-scenes power tool** Managing a CKAN power data portal requires attentiveness to more than just publishing datasets. Security patches, performance tuning, daily backups, and uptime monitoring are tasks that can quietly eat into your team’s workload or fall through the cracks altogether. A managed hosting partner handles these behind-the-scenes issues, so your team can stay focused on user needs, data integrity, and insights. ## **Who benefits most from managed hosting?** ### **Organisations without in-house IT teams** Managed hosting delivers professional-grade reliability without needing to hire sysadmins. ### **High-traffic CKAN portals** Whether you’re running custom extensions or handling heavy API activity, managed hosting ensures your platform scales without performance drops. ### **Teams with data protection obligations** Whether you’re navigating GDPR, ISO 27001, or other compliance standards, a good hosting provider can bring the right tools, including encryption, intrusion detection, and secure backups. ## **Common mistakes when choosing a hosting provider** But not all managed hosting offers are created equal. Link Digital has seen common managed hosting mistakes that cost organisations time, money, and, in the worst cases, trust. ### **Making a choice based on cost alone** A cheaper provider may leave out essential services, like 24/7 monitoring or disaster recovery. What you save upfront can cost you more later. ### **Underestimating support quality** Downtime happens. The real test of a hosting provider is how quickly they can take action and solve the issue. ### **Skipping over security credentials** It’s no longer enough to have a firewall. You need active threat detection, vulnerability scanning, and regular audits. ## **Find out about the following before you choose a CKAN hosting partner:** 1. **What’s actually included in their services?** Will they be managing just the server, or also your CKAN instance, database, and extensions? 2. **How do they handle performance?** Low latency – the time lag between a request to your portal and a response – matters. Ask about the server specs, caching, and Content Delivery Network integrations . You can also consult your project data manager or IT consultant in this scenario. 3. **What security standards do they follow?** Look for multi-layer protection, ISO-compliant protocols, and incident response plans. Does your organisation require a specific ISO certificate from its provider? 4. **Can the setup scale?** CKAN can handle a large number of users and datasets, but the exact number depends on various factors like hardware, configuration, and how the system is used. Can your potential hosting provider scale up as your portal does? 5. **What’s their backup and recovery plan?** Clarify how often your data is backed up and how quickly it can be restored. 6. **What level of support do they offer?** Is 24/7 coverage specified in the SLA? Are support tickets resolved by the product owners or developers who know CKAN? Can they provide support to the part of the world you operate in? 7. **Is the SLA transparent and measurable?** Clarify the uptime; support response times and escalation paths should be clearly defined in the SLA. ## **What Link Digital brings to managed hosting** At Link Digital, we support government agencies, NGOs, and research and academic institutions across the globe with tailored CKAN hosting solutions. Our focus is not just on keeping your portal online, but about making sure your infrastructure is a strength, not a source of stress. ### **Here’s how we do it:** #### **Proactive system management** We monitor everything, resolve issues before they become problems, and ensure your portal stays fast and available. We have certified professionals experts in all the major cloud hosting platforms – Amazon Web Services, Microsoft Azure, and Google Cloud. #### **Security-first mindset** We manage the security infrastructure of high-level portals for government and other organisations. From secure data centers to regular audits and DDoS attack mitigation, we handle security so you don’t have to worry. #### **Flexible infrastructure** Whether you’re rolling out a new dataset catalogue or expanding an existing portal to serve an entire region, we can scale with you. #### **Global expertise, local context** Our expert team supports clients globally, always with a deep understanding of public sector needs. #### **Commitment to open source** We are CKAN experts. As one of the software’s major developers, we contribute directly to the CKAN ecosystem, ensuring our hosting knowledge goes beyond maintenance and into active contributions. --- Whether you’re launching your first open data portal or looking to improve uptime and security on your existing CKAN deployments, managed hosting isn’t just an IT decision. It’s a strategic one that needs careful steps. Didn’t see what you’re looking for from the lists above? Need help with managed hosting? [Message us.](http://linkdigital.com.au/get-in-touch) - [Facebook](https://www.facebook.com/LinkDigital) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/) **Categories:** All articles, Amazon Web Services (AWS), CKAN, Drupal, Industry, Microsoft Azure, Open Data, Technology Infrastructure, Topics **Tags:** CKAN, CKAN hosting, Managed hosting --- ### [Data4me: a best practice in data portal configuration](https://linkdigital.com.au/news/2024/03/data4me-a-best-practice-in-data-portal-configuration/) **Published:** March 7, 2024 **Author:** Andrew Nette **Excerpt:** The Data4me site is working on linking to more portals for data harvesting (Data.NSW and the NSW Climate Data Portal to start with), increasing its useability, and exploring the potential for Artificial Intelligence to help with the data searching process. **Content:** August 4, 2026 [In](https://linkdigital.com.au/news/2024/02/reimagining-open-data-portals-debates-and-research-paths/) [February 2024](https://linkdigital.com.au/news/2024/02/reimagining-open-data-portals-debates-and-research-paths/), [Link Digital](https://linkdigital.com.au/) discussed some of the emerging best practice for open data portals and how they might be reimagined in the future. This included the need for portals to become more focused on heightened data transferability and usability features, improved standards to maximise interoperability, and the provision of improved metadata and data lineage features for enhanced user comprehension and re-use. Such improvements may be especially important for government open data activities as these evolve from a primary focus on transparency to more complex issues involved in knowledge management. For example, how data is better shared internally and externally, catalogued, and how it is made discoverable for a range of human and non-human actors. ## **Examples of how open data portals might be improved** One example for how open data portals might be improved was the subject of [Link Digital’s](https://linkdigital.com.au/) recent Monthly Forum, at which [Tom Barrett](https://www.linkedin.com/in/tom-barrett-601ba63/), Senior Scientist in the Science, Economics and Insights Division of the [New South Wales Department of Climate Change, Energy, the Environment and Water](https://www.nsw.gov.au/departments-and-agencies/dcceew) (DCCEEW), presented on an innovative new portal called Data4me. Data4me emerged from Barrett’s personal experience, including applying Geographic Information System-based (GIS) tools to support conservation and natural resource management planning decisions. “It’s really a culmination of thirty years of real frustration and anguish associated with trying to use data to undertake projects.” The core problem was the huge and growing volume of data in open data portals at national, state and local levels. This rendered the portals little better than data registries and made it difficult not only to find the right data, but to share knowledge about it, and manage data for specific projects. Managing data “is often something that gets left to the end of project… It often is done hastily or drops off altogether. So, one of the objectives of Data4me is trying to develop a tool that users can actually use to manage their data from the beginning and all the way through the project, so it’s not a mad rush at the end.” [During the presentation, ](https://www.youtube.com/watch?v=SZ-hw7T2Ro8)Barrett made an analogy to online tools such as TripAdvisor, that allow users to pick a service and look at what others have said about it, only in this instance applied to government workers that use data. The Data4me platform, which [Link Digital](https://linkdigital.com.au/) worked on, is an internally facing data portal, that uses the [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN), a piece of open-source software that can be configured and set up to function as an open data platform once it is deployed and hosted on a web server. Data4me harvests data from two NSW government portals, which [Link Digital](https://linkdigital.com.au/) helped develop, and which also use CKAN: DCCEEW’s internal asset register and a public facing repository of environment data in NSW, [Sharing and Enabling Environmental Data](https://www.seed.nsw.gov.au/) (SEED). Data4me enables DCCEEW staff to register projects and search for data/metadata from SEED and the internal asset register and consolidate what they find on their own project page. This search can be based on themes, key words or by other projects being undertaken that might have relevance to what the searcher is doing. They can also see who is running other projects and contact them. Crucially, in terms of debates around how to open data portals might be better configured to provide a more comprehensive descriptive record of datasets that goes beyond very basic metadata, Data4me enables users to record feedback on data. This can include whether the data was fit for purpose for the project in question, and its pros and cons, etc. Users can also attach other related information, for example relevant journal articles that they may have written. The aim is that this contributes to a much larger repository of supporting documentation that can be immediately accessed from within the dataset and is context sensitive. Users can see comments from others who have used data that they are thinking of examining, to help them make decisions as to whether it might be useful, and to join the dots between projects, documentation, and the people involved in them. It also gives users the ability to run a report at the end of their project that creates a list of citations of the data they have used. As Barrett put it: “In an ideal world you would also register the outputs of your project, if they are data, and they then can be re-related to your project, which completes its life cycle.” ## **The ongoing process of monitoring and evaluation** In addition to an ongoing process of monitoring and evaluation, Data4me site is working on linking to more portals for data harvesting ([Data.NSW](https://data.nsw.gov.au/) and the [NSW Climate Data Portal ](https://www.environment.nsw.gov.au/)to start with), increasing its useability, and exploring the potential for Artificial Intelligence to help with the data searching process. Barrett told the [Monthly Forum](https://www.youtube.com/playlist?list=PLNYR4MdBNnu-vHzvMk92VVjG5UZO9Ed5K) that future challenges include figuring out how Data4me fits into DCCEEW’s larger data management ecosystem, as well as other communities of data practice. The most significant challenge, however, is promoting the site and motivating users to leave feedback on data they use. This requires cultural change within DCCEEW to make Data4me regarded as just another tool staff use when they start a project. “I suppose there is an element of crowd sourcing that this relies on, and this is a critical factor, that we need that crowdsourcing of sharing of knowledge, so it gets to a critical mass where people find it useful and will use it.” While Data4me has not reached such a critical mass yet, [Link Digital](https://linkdigital.com.au/) believes it provides a fascinating example of what might be possible in relation to data portal configuration, and we look forward to seeing how it develops in the future. [You can watch Barrett’s entire presentation and the discussion that followed it on Link Digital’s YouTube channel here.](https://www.youtube.com/watch?v=SZ-hw7T2Ro8&t=101s&utm_source=recap&utm_medium=blog) **Latest articles** - [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) - [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) - [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) - [When the visitors aren’t human: What rising bot traffic means for your data portal](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) - [From open data to verifiable honesty: An experiment you can look at](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) **Categories:** All articles, CKAN, Government, Open Data --- ### [Creative bureaucracy 2026: Is the way we define trust enough to stem democratic erosion?](https://linkdigital.com.au/news/2026/06/creative-bureaucracy-2026-is-the-way-we-define-trust-enough-to-stem-democratic-erosion/) **Published:** June 16, 2026 **Author:** Andrew Nette **Content:** The theme of the 10th [Creative ](https://creativebureaucracy.org/)[Bureaucracy](https://creativebureaucracy.org/)[ Festival](https://creativebureaucracy.org/), which took place in Berlin in early June, was ‘Creative Bureaucracy – Stronger Democracy’. It was a nod to the concern present in most of the sessions I attended during the day-long event: the increasing influence of far right political parties and movements, growing public dissatisfaction with parliamentary democracy, and the challenge these present to preserving and strengthening democratic space and public trust in government and its institutions. If there was a word of the day for me, it was “trust”. This was signalled from the very first session, in introductory remarks by the Festival’s co-founder [Charles Landry](https://www.charleslandry.com/). Born in London to German parents who had escaped from the Nazis, Laundry evoked the 1930s when he said, “Again, trust has become fragile… And when trust weakens, something else takes its place.” While he was referring to the rise of populist far right movements in Europe, Landry was quick to note that the erosion of trust in government is an OECD wide phenomenon. But what exactly are we talking about when we discuss trust? How do we define, preserve and build it? The following article will unpack these questions in relation to some of the discussions that took place during the Festival. ## **Effective service delivery and trust** “A strong democracy is about developing stronger institutions that people can believe in,” claimed [Philip von Haehling](https://www.pd-g.de/ueber-uns/management-und-gremien/management/philip-von-haehling), Managing Director of PD, a German in-house management and strategic consultancy that works exclusively with the public sector. “We don’t lack ideas, what we lack is delivery.” The most common lens through which the trust issue was explored throughout the Festival, this framing touched on several issues: the need for government to deliver functioning services; the challenge facing public administrators in terms of working smarter, with less staff and less resources; and the need to close the gap between those in government who design policy change and those who deliver it. It was also linked to the argument, made by some speakers I listened to over the course of the day, that our current institutions are not fit for purpose to solve complex issues. As one speaker put it: “No one owns problems or is on top of them. This is the perception of a lot of the public and it is eroding democratic support.” “A good example is AI,” claimed [Tamara Srzentić](https://www.linkedin.com/in/tamarasrzentic/), the Former Minister of Public Administration, Digital Society and Media of Montenegro. “A lot of people in government talk about AI but no one seems to be on top of it. There is a view that there is no structure around it and that its development has been decoupled from social connection.” A strong example of the connection between trust and efficient digital services was made in an inspiring presentation on [Rumah Pendidikan](https://rumah.pendidikan.go.id/), the integrated national digital platform offering dedicated services to stakeholders in the Indonesian education system. Developed by the Indonesian Ministry for Education, it features a mixed tech stack of open source and proprietary solutions and has been implemented countrywide. The platform was designed to reverse below minimum competency identified in Indonesian school students in literacy and numeracy and provide data and resources to teachers and school principals. There were significant challenges unique to Indonesia in getting the platform up and running: an administrative area made up of seventeen thousand islands, major linguistic diversity, and very differing levels of technological capacity and know-how amongst teachers and principles. The platform required not just a technical solution but a mindset change to the way that government bureaucrats thought about education provision. And, crucially in terms of building both trust and a lasting digital infrastructure, the platform was able to survive attempts by the new administration post national elections in early 2024, to kill it off. The platform has been so successful that early indications that it might be replaced were met with a concerted social media lobbying campaign by the teachers, which convinced the new administration to shelve its plans. [*Also read: What is digital public infrastructure, and can it help reverse the decline in public trust in government?*](https://linkdigital.com.au/news/2025/10/what-is-digital-public-infrastructure-and-can-it-help-reverse-the-decline-in-public-trust-in-government/) ## **The importance of open source technology** The value of open source software was another component of the discussions around building trust. “Citizens do not care which government agency provides a digital service,” said digital strategist [Pamela Krosta-Hartl](https://www.linkedin.com/in/pamela-krosta-hartl/). “They just want it to be reliable.” According to Krosta-Hartl, open source technology is not just an economical software licensing model, its “most important lessons are cultural”. It can help to avoid a common problem plaguing government service delivery – different levels of government using scarce resources to solve the same problems repeatedly. “Open source enables collaboration at scale. Many of the digital challenges today are common. No single country in Europe needs to solve basic problems by themselves.” Open source can also play a vital role in helping to build secure software pipelines and digital solutions that can support digital sovereignty, another key topic for many of the Festival’s participants Data sovereignty is the concept that states have the right to control their own digital future. This means not only having authority over the data they possess, but also the hardware and software that make up their digital infrastructure, ensuring these are governed by local laws and values rather than being reliant on, or controlled by foreign tech giants or external nations. This has become a major strategic concern in Europe, not only due to the huge amount of data that governments are sitting on, but because reliance on foreign tech giants can create dangerous vulnerabilities, from political coercion to supply chain issues. Signalling this concern, in early June the European Union presented [a European Technological Sovereignty Package](https://commission.europa.eu/news-and-media/news/strengthening-europes-tech-sovereignty-2026-06-03_en), a set of measures to strengthen Europe’s technology sovereignty by increasing capacity in areas like semiconductor production, AI, and cloud computing. Open source technology will play a major role in the package. ## **Do we need to think about trust differently?** But is our current way of thinking about trust enough to meet the challenges we now face? This was a question hinted at by former Greek Prime Minister [George Papandreou](https://en.wikipedia.org/wiki/George_Papandreou) early in the Festival’s proceedings but to my knowledge not followed up in any of the subsequent sessions. Discussing the decline in trust in parliamentary democracy, he noted that it is not enough to just give the public participation via a parliamentary vote every three to four years. “We need more direct forms of participation,” he said. This comment made me think of ongoing work being facilitated by Link Digital, which examines the concept of trust through the perspective of open data, open source systems, and digital infrastructure. This argues that in an era of black-box algorithms and fractured public narratives, society has moved past the point where trust can simply be assumed or demanded on the part of governments, no matter how efficient their service delivery may be. Instead, trust must be treated as an engineered, structural property. Central to this framework – [which Link Digital’s Executive Director Steven De Costa expounded on in this public talk in Canberra in early 2026](https://www.youtube.com/watch?v=ScLu6igd7Ho) – is the concept of causal continuity; the collective ability to transparently trace and agree on how data or the conclusions drawn from it came to be. In other words, data portals and algorithmic processes need to stop hiding their inner workings and be completely observable, communicable, and externally accountable. This definition of trust, which differs from the one which dominated much of the discussion at the Festival, requires building open public data infrastructures with communities rather than just about them, grounded in explicit statements of intent. It also requires governments to stop treating data as a product for public “access” and instead build open, observable data pipelines that allow citizens to explicitly verify the intent, source code, and logic behind every bureaucratic and algorithmic decision. The framework – which is already influencing the way that we build open data portals – and the challenge it presents to governments in terms of being fully open is something Link Digital would like to see more discussion about. **Categories:** All articles, Artificial Intelligence, Digital Public Infrastructure, Government, Objective Observe Initiative **Tags:** Creative Bureaucracy Festival 2026, data sovereignty, Digital public infrastructure, Open source technology, trust and democracy --- ### [Ask AI: Link Digital’s AI layer for smarter CKAN portals](https://linkdigital.com.au/news/2026/03/ask-ai-link-digitals-ai-layer-for-smarter-ckan-portals/) **Published:** March 10, 2026 **Author:** Oleksandr Cherniavsky **Content:** ## **The modern data challenge** Open data portals have matured significantly over the past decade. Many organisations now operate CKAN – [Comprehensive Knowledge Archive Network](https://ckan.org/) – instances containing hundreds, if not thousands of datasets. Metadata is structured, application programming interfaces are exposed, and search is functional. Yet a persistent friction remains: discovery and interpretation. Users still struggle to locate the right dataset when they don’t know the exact terminology. They manually inspect metadata. They download files to understand the structure. In practice, access exists, but usability often lags far behind. Ask AI, a new [Link Digital ](https://linkdigital.com.au/)feature, introduces an AI-powered layer on top of CKAN to address that gap. The goal is straightforward. To make data portals conversational, contextual, and semantically searchable. ## **Moving beyond keyword search** Traditional CKAN search matches keywords in titles, descriptions, and other metadata fields. This works well when users know the exact phrasing used by publishers. But real-world users often search differently. A person looking for ‘police reports’ might miss a dataset labelled ‘crime statistics’. Someone interested in ‘ocean pollution’ may never type ‘marine ecosystem degradation’. Ask AI introduces semantic similarity search. Instead of matching words, it matches meaning. Behind the scenes, dataset and resource metadata – along with supported document content – are converted into vector embeddings and stored in PostgreSQL using an extension called [pgvector](https://github.com/pgvector/pgvector). When a user performs a search, the system retrieves results based on semantic proximity rather than simple text overlap. The effect is immediate: - Broader recall without sacrificing relevance - Discovery across inconsistent terminology - Reduced dependence on perfect metadata alignment For organisations managing large portals, this materially improves dataset discoverability without requiring publishers to change workflows. ![semantic search on datasets on CKAN](https://linkdigital.com.au/wp-content/uploads/2026/03/Search.gif)Semantic search ## **‘Ask AI’ at the dataset level** Each dataset page includes an ‘Ask AI’ interface. Instead of manually parsing descriptions, formats, or publisher information, users can ask direct questions: - What is this dataset about? - Who published it and when? - What formats are available? Dataset metadata is indexed and embedded in the background whenever a dataset is created or updated. This indexing process runs asynchronously to avoid impacting user performance. Updates are synchronised as needed to ensure AI responses remain aligned with current portal content. The Ask AI assistant uses structured prompt templates to generate consistent, context-aware responses. It does not operate blindly but receives specific metadata context relevant to the dataset being viewed. ![CKAN extension: Ask AI (Knowledge Assistant) by Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/03/Dialog-Dataset-576x1024.gif) ## **Document-level intelligence** Many portals host more than structured metadata. Reports, PDFs, spreadsheets, and presentations often contain critical context. Ask AI extends indexing beyond metadata to selected resource file types: - PDF - DOCX - TXT - Markdown - HTML - CSV - XLSX / XLS - PPTX Supported documents are processed and embedded into the vector store. Users can then query the content directly, including asking - To summarise a report - What are the key findings? - Is there any mention of a specific topic? Instead of downloading a 100-page PDF and searching it manually, users receive contextual responses grounded in the document itself. For organisations publishing analytical reports or policy documents, this significantly improves accessibility. ## **Querying tabular data without writing SQL** One of the most technically impactful features is the integration with [CKAN’s DataStore extension](https://linkdigital.com.au/news/2024/10/from-climate-data-catalogues-to-dataset-storage-the-ckan-extensions-that-make-it-possible/#:~:text=%E2%80%9CThe%20CKAN,with%20this%20plugin). When users ask analytical questions about tabular data, Ask AI can generate SQL queries through the DataStore API. Retrieved records are then provided as structured context to the language model to produce a response. For example, a simple analytical request may trigger a generated query such as: SELECT fields FROM resource\_table LIMIT N Users do not see or write SQL. The system constructs queries dynamically based on schema awareness. This lowers the barrier for non-technical users while preserving the integrity of the DataStore. It transforms the portal from a static repository into an interactive analytical surface. In addition, the assistant does not rely solely on live querying for every interaction. For DataStore-backed resources, we precompute lightweight statistical summaries, such as column types, value ranges, distinct counts, and basic aggregates. These summaries are stored and used as contextual hints during prompt construction. This serves two purposes. First, it improves performance by reducing the need for exploratory SQL queries when the model only requires structural understanding. Second, it guides the model toward generating more accurate and efficient SQL, since it already has awareness of the dataset’s shape and characteristics. ## **Architecture overview** The architecture is intentionally conservative, and infrastructure aligned. - Embeddings are stored in PostgreSQL using pgvector. - Indexing runs in background jobs and synchronises on updates. - No specialised caching layer is introduced; the system relies on model-level caching where applicable. - Prompt templates ensure structured and repeatable interactions. - Access is restricted to registered users for agent-based queries. This design minimises operational complexity while remaining scalable within existing CKAN deployments. Organisations do not need to adopt an entirely new stack. The assistant integrates directly into the CKAN ecosystem. Different organisations have different risk profiles and infrastructure constraints. Ask AI supports multiple backend options: - Ollama (local models) for privacy-sensitive, on-premises deployments - OpenAI for high-quality cloud-based responses ![CKAN extension: Ask AI](https://linkdigital.com.au/wp-content/uploads/2026/03/Settings-1024x794.webp)Ask AI settings Configuration is handled via the CKAN configuration file, and several runtime parameters can be adjusted through the Admin Panel UI: - Model temperature - Request timeouts - Semantic search top-k values - Query expansion toggles - DataStore result limits - Context window settings (for Ollama) This allows administrators to tune performance, cost, and response behaviour without redeploying the system. ## **Security and permission awareness** Security alignment with CKAN is fundamental. Ask AI respects CKAN’s native permission model. Private datasets remain inaccessible to unauthorised users. Permission labels are applied during filtering to ensure that search and AI responses only include datasets visible to the querying user. If a user does not have access to a dataset, it is neither retrieved nor referenced in responses. When deployed with local AI models, data remains entirely within organisational infrastructure. For institutions with strict data residency requirements, this is a critical capability. ## **From Portal to Intelligent Interface** The transformation can be summarised simply: Before: - Keyword-only search - Manual inspection of metadata - SQL required for deeper analysis After: - Semantic similarity search - Conversational dataset exploration - LLM-generated DataStore queries This shift repositions CKAN from a repository to an intelligent interface layer over public sector knowledge assets. ## **A practical step towards AI-enabled open data** Artificial intelligence is often discussed abstractly in the open data ecosystem. Ask AI takes a pragmatic approach. It does not attempt to reinvent CKAN or introduce excessive architectural overheads. It focuses on usability, discovery, and interaction. For organisations managing large data portals, the question is no longer whether AI will influence user expectations. It already has. The question is whether your portal will remain a searchable archive, or evolve into a conversational, intelligent gateway to public data. Ask AI represents one practical path forward. ## Sign up for a demo Sign up for a demo, and we can talk about your project and how Ask AI can improve your users’ interactions with data . [Get in touch to discuss how we can help](https://linkdigital.com.au/get-in-touch/). **Categories:** All articles, Artificial Intelligence, CKAN, DCAT (Data Catalog Vocabulary), Digital Public Infrastructure, Environmental/Climate Change, Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Internal data hub, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** CKAN, CKAN extension, data portal --- ### [From Data Storage to Machine-Ready Intelligence: Welcome to Your Modern Data Portal](https://linkdigital.com.au/news/2026/07/from-data-storage-to-machine-ready-intelligence-welcome-to-your-modern-data-portal/) **Published:** July 16, 2026 **Author:** Kate Sampher **Excerpt:** Discover Ask AI by Link Digital, an intelligent layer that transforms your CKAN data portal from a passive storage facility into a high-impact insight engine. **Content:** While [the Comprehensive Knowledge Archive Network – CKAN](https://ckan.org/) provides world-leading infrastructure for data management, overcoming the persistent discovery gap in open data portals is the final frontier of accessibility. For years, organisations have focused on openness, making datasets available, but availability does not equal accessibility. Link Digital is bridging this gap with **Ask AI**, an intelligent layer that transforms your CKAN data portal from a passive storage facility into a high-impact insight engine. By enabling natural language interaction, we ensure your data is not just stored but actively used to solve real-world problems. - [The core capabilities of an AI-powered data portal](#aioseo-the-core-capabilities-of-an-ai-powered-data-portal-3) - [Ask a question, get an answer: the chat interface](#aioseo-ask-a-question-get-an-answer-the-chat-interface-5) - [Turn 100-page reports into executive summaries](#aioseo-turn-100-page-reports-into-executive-summaries-11) - [Semantic search: context on the results page](#aioseo-semantic-search-context-on-the-results-page-15) - [Refine metadata with an intelligent assistant](#aioseo-refine-metadata-with-an-intelligent-assistant-20) - [Deep insights with user analytics](#aioseo-deep-insights-with-user-analytics-25) - [Security and data sovereignty: AI use without compromise](#aioseo-security-and-data-sovereignty-ai-use-without-compromise-29) - [Improve your CKAN portal with Link Digital](#aioseo-improve-your-ckan-portal-with-link-digital-32) ## The core capabilities of an AI-powered data portal Link Digital’s new Ask AI feature introduces a fundamental shift in how people interact with information systems. Here is how it does this. ### Ask a question, get an answer: the chat interface At the heart of the experience is a simple chat interface that replaces technical search syntax with **natural language interaction**. Instead of wrestling with exact publisher keywords, researchers and users can ask questions in plain language and receive instant, data-backed answers grounded in your verified files. **Benefit**: For data portal users, this turns the portal into a conversational assistant that provides direct answers rather than a list of links to sort through. ![](https://linkdigital.com.au/wp-content/uploads/2026/07/img-Ask-AI-chatbot-1024x569.png) ### Turn 100-page reports into executive summaries Navigating multiple PDF reports or massive spreadsheets is no longer a manual chore. Ask AI automatically generates executive summaries from complex documents, instantly transforming static files into usable knowledge. A data portal user can type “What was the average carbon emission in this region last year?” straight into the chat, and Ask AI returns a direct answer grounded in the portal’s data. Because it uses Retrieval-Augmented Generation (RAG), the response is restricted to your verified files, so the AI cannot guess or hallucinate. **Benefit**: Users save hours of manual work by extracting key takeaways from lengthy technical reports in seconds. ![Ask AI PDF Summary - Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/07/img-Ask-AI-PDF-summary-1024x576.png) ### Semantic search: context on the results page Beyond keyword matching, Ask AI utilises **semantic search** to understand user intent. When a user searches for specific data, the portal provides immediate context and summaries, allowing users to pinpoint exactly what they need without having to open multiple datasets. **Benefit**: Users find the right data even if they don’t know the exact terminology used by the publisher, improving discoverability across inconsistent metadata. ![](https://linkdigital.com.au/wp-content/uploads/2026/07/img-semantic-search-Ask-AI-scaled-1024x655.png) ### Refine metadata with an intelligent assistant Good data relies on high-quality metadata. Ask AI acts as an assistant for portal administrators, helping to generate and refine metadata with a single click. This ensures that the data on your portal remains highly discoverable without the burden of having to manually enter and edit it. **Benefit**: Administrative teams can maintain a properly categorised portal with significantly less manual effort. ### Deep insights with user analytics To truly understand your portal’s performance and how users are engaging with your new AI features, your admin dashboard needs the critical information in one place. In addition to the Ask AI features above, CKAN enables you to better understand how people are actually using your portal. Using the [*ckanext-better-stats extension*](https://github.com/DataShades/ckanext-better-stats) as a starting point, you can track a range of metrics and monitor user engagement and portal health so you can see what’s being used, what’s being missed, and where to focus next. ## Security and data sovereignty: AI use without compromise Because your **data sovereignty** is non-negotiable, Ask AI is built with a security-first architecture. Unlike generic AI tools, RAG ensures your data never leaves your secure environment and that any responses are auditable and 100% accurate. ## Improve your CKAN portal with Link Digital If you want to see a[ demo of Ask AI using CKAN 2.11 or the CKAN 2.12 development branch, you can watch it here.](https://www.youtube.com/watch?v=7gG0Zq90EvE) Link Digital is ready to help you unlock the true potential of your datasets through **AI-powered data discovery**. **Categories:** All articles, Artificial Intelligence, CKAN, Environmental/Climate Change, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** Ask AI, CKAN --- ### [The Honest Series #1: Does the system lie to itself? The Theory of Complex Systems](https://linkdigital.com.au/news/2026/07/the-honest-series-1-does-the-system-lie-to-itself-the-theory-of-complex-systems/) **Published:** July 14, 2026 **Author:** Andrew Nette **Content:** In data science, algorithmic design, and institutional governance, the pursuit of perfection is increasingly treated as a necessary virtue. Modern systems are routinely optimised to erase all anomalies, minimise all errors, and smooth out the complex and untidy irregularities of human behaviour. But what if the truth is more counter-intuitive; that a completely optimised, hyper efficient system that eliminates all error is inherently brittle and increasingly incapable of survival? This is the contention put forward by [Professor Simon Reay Atkinson](https://www.linkedin.com/in/simon-reay-atkinson-27094316/), an[ expert in complex adaptive systems from the University of Sydney Business School](http://google.com/url?q=https://www.sydney.edu.au/business/&sa=D&source=docs&ust=1783956620402112&usg=AOvVaw0uFkuelQdHPe3EGO1VeCm8), in the first of [Link Digital’s ](http://linkdigital.com.au)new Honest Series of conversations. The theory behind Atkinson’s talk is explored in greater detail in a paper, co-authored by Atkinson and [Link Digital’s Executive Director Steven De Costa](http://linkedin.com/in/stevendecosta?originalSubdomain=au), *The lie is to the perfect as perfection is to life: If to err is human, to forgive is divine – what future when AI plays divine?* The following article will briefly recap Atkinson’s webinar presentation. ## The need for systematic variance In the context of Atkinson’s talk “the lie”, deceit, or error does not imply any malicious falsehood. Rather, it represents the importance of systemic variance. “We’re not encouraging people to lie,” said Atkinson. “But what I do think we’re looking at is what makes the oyster. It’s the grit in the oyster that makes the oyster. Without grit in the machine, we essentially end up in perfection and perfectionism.” “And the work that Steven and I have been examining has led us to a conviction that there is a great threat posed by AI in that its virtue is that it removes variance and error. That very variance and error is what enables humanity to change, adapt and, if you like, to live. You remove that or you end imperfection, and you essentially remove life itself.” For data professionals and structural designers, there are two core themes in Atkinson’s argument that raise questions about how they should collect, interpret, and implement data in an increasingly automated world. The first centres on the necessity of systematic variance, or what Atkinson called “jitter” and “hunting”. He maintains that in complex adaptive systems, variance is not a structural failure to be purged; it is the exact mechanism that enables adaptation and resilience. When an algorithm or model achieves mathematical perfection, it leaves no room for adjustment. It freezes the institutional architecture into a state of structural rigor mortis, rendering it unable to handle unexpected real-world shifts. He illustrated this point with reference to Australia’s now infamous Robo-debt scandal. This involved an unlawful automated welfare debt recovery scheme implemented by a previous Australian government from 2015 to 2019. It used income leveraging to incorrectly accuse hundreds of thousands of welfare recipients of owing money to the government, resulting in severe financial hardship, trauma, and suicides. Atkinson set out how the system utilised a rigid, highly optimised averaging algorithm to detect income discrepancies. Because the model assumed its mathematical abstractions were a perfect mirror of reality, it treated any real-world variance as deliberate deceit. It lacked an analogue “hunting” loop – the capacity to hesitate around a point, estimate, and allow for systemic friction. In the case of the Robo-debt scandal, the system reduced human complexities to an unyielding mean, resulting in automated absurdity and human tragedy. “If you have a highly optimised perfect system, there is no room for life. And, therefore, within that, the deceit – the variance – actually becomes what gives us life; that enables adaptation and change.” For data professionals, this theme is an urgent warning against over-fitting models and over-automating decisions. When data systems operate purely within the strict, flattened confines of digital tokens, they replace nuanced conceptualisation with sterile representationalism. This rigidity can also breed algorithmic hallucinations when a system encounters different realities. Atkinson contends that data architects must intentionally build grit back into their systems, ensuring that models retain analogue-like estimation spaces where variance is audited and integrated rather than blindly flattened. ## **Why institutional ethics are not the same as human morality** The second theme in Atkinson’s presentation is the important distinction between institutional ethics and human morality, and how this divergence necessitates “cognitive variety” over simple “managed diversity”. Atkinson argued that ethics often manifests as scripted logic – a playbook of rules, constraints, and algorithmic boundaries. Morality, conversely, is an existential human attribute rooted in lived experience, empathy, and localised judgement. He demonstrated this point with reference to his field experience during the brutal conflict between Bosnia and Herzegovina from 1992 and 1995. In particular, the incident that occurred when a Dutch United Nations battalion, strictly adhering to their explicit rules of engagement, stood back while thousands of men and boys were marched away to their deaths in what became known as the Srebrenica massacre. “The \[Dutch\] colonel obeyed the rules of engagement. The rules of engagement gave him the ethical authority to stand back. The result was that 5,000 men and boys were marched away and massacred.” According to Atkinson, the commander in question possessed complete ethical authority under their scripted logic, yet the outcome was an absolute moral failure that not only led to large-scale deaths but devastated the battalion’s long-term morale and psychological stability. In other words, a system can be entirely ethical – and compliant with its internal rules – while being fundamentally immoral. Data-driven organisations, whether they be the modern public service or corporations run the risk of dangerous institutional blindness when they mistake adherence to regulatory data metrics or compliance checklists for genuine systemic health. Instead, they must cultivate true cognitive variety, the ability to bring together empirical problem solvers, engineers, humanists, and artists who operate outside identical conceptual models. Without cognitive variety to challenge the data inputs, organisations become “zombie institutions”—perfectly compliant, yet entirely detached from reality. “If we have no agility in organisation, then we’ve got fragility, zombieism and unhappiness.” ## The path forward for modern data practices What is the primary takeaway of this for data scientists? Ultimately, it shifts their role from that of an agent of total optimisation to a curator of balanced complexity. Data models should never be decoupled from the messy, existential pulse of human intent. By designing frameworks that respect systemic jitter and by building diverse cognitive networks to audit automated logic, data professionals can ensure their systems remain resilient, ethical, and fundamentally aligned with human life. ![Does the system lie to itself](https://linkdigital.com.au/wp-content/uploads/2026/07/YT-Thumbnail-The-Honest-Series-Episode-01-1024x576.png "Webinar banner of The Honest Series episode 01")You can watch the full recording of Atkinson’s talk on our [YouTube channel here.](https://www.youtube.com/watch?v=VL6IfZpzWZ0) You can find the research paper mentioned earlier, [***The lie is to the perfect as perfection is to life*** here,](https://linkdigital.com.au/wp-content/uploads/2026/07/The-lie-is-to-the-perfect-as-perfection-is-to-life-1.1-Simon-and-Steven-copy.pdf) which directly expands on the core theme discussed in the webinar. **Categories:** All articles --- ### [Open data, CKAN, and the philosophy behind the Objective Observer Initiative](https://linkdigital.com.au/news/2025/04/open-data-ckan-and-the-philosophy-behind-the-objective-observer-initiative/) **Published:** April 29, 2025 **Author:** Kate Sampher **Excerpt:** This article summarizes the fifth episode of Tuesday Talks in which Alex Gostev interviewed Steven de Costa, founder of Link Digital, about the challenges and potential of open data initiatives in the current global environment. **Content:** June 26, 2026 This article summarises the fifth episode of Tuesday Talks, in which Alex Gostev interviewed [Steven De Costa, founder of Link Digital,](https://www.linkedin.com/in/stevendecosta/) about the challenges and potential of open data initiatives in the current global environment. ## Summary of the interview Steven highlights the existential dilemma facing open data due to stagnant, or ‘just enough’ demand, which risks undermining the drivers needed for improving the quality, quantity and diversity of supply. He mentions the importance of aligning data releases with community needs and building action that transforms raw data into structured knowledge. Steven also contrasts “pull” and “push” based economies of intent in relation to how human capital is effectively contracted into markets via offers. In addition, he shares a philosophy of self that underlies the Objective Observer Initiative, a proactive and humanist framework that aims to recognise that explicit agreements, defined within explicit systems, have the potential to support honest interactions and public-interest data that is built from the ground up to respect individual sovereignty and structured cohesion across societal systems. Ultimately, the talk emphasises open data’s transformative potential for society, alongside a call for mindful technology use and community engagement. ## **Timestamped highlights** ### [**\[00:02:30\]** – **Steven founding Link Digital and his journey into open data**](https://youtu.be/KtsCltgt4Cs) Steven shares his background in economics and building web infrastructure, narrating how his proximity to government operations in the Australian capital Canberra inspired his interest in open data. He reflects on the human aspects behind bureaucracies, which provide insight into the operational challenges in data accessibility. ![Open data supply](https://linkdigital.com.au/wp-content/uploads/2025/04/Diagram-open-data-supply-1.png)Open data supply as shown at 07:29 timestamp ### [**\[00:08:42\]** – **Transforming raw data into knowledge**](https://youtu.be/KtsCltgt4Cs?t=522) Steven explores how raw data can be translated into structured knowledge that can serve the public interest. Steven articulates the importance of aligning data with community objectives to enhance its value and promote societal outcomes. ![Knowledge and decisions diagram](https://linkdigital.com.au/wp-content/uploads/2025/04/Diagram-knowledge-and-decisions-1-1024x949.png)Knowledge and decisions diagram as shown at 09:29 timestamp ![CKAN and its ecosystem](https://linkdigital.com.au/wp-content/uploads/2025/04/Illustration-CKAN-and-its-ecosystem-1-1024x725.png)CKAN and its ecosystem diagram as shown at 12:11 timestamp ### [**\[00:14:33\]** – **Lack of demand for open data**](https://youtu.be/KtsCltgt4Cs?t=873) Steven voices his concerns regarding the current state of open data, emphasizing the threats now facing open data and the need to generate demand for it. The opportunity is to generate demand based on the potential of well-refined open data connected into civic systems. He warns that stagnant interest in open data may lead to fewer initiatives being undertaken in this space and outlines the critical points of connecting open data to societal benefits. ### [**\[00:21:30\]** – **Pull vs. Push economies**](https://youtu.be/KtsCltgt4Cs?t=1290) Steven shares the concepts of “pull” and “push” economies in relation to trust and knowledge-sharing practices. He advocates for a shift towards transparency, which can redefine employment dynamics and mitigate issues of exploitation in technology. ### [**\[00:32:59\]** – **The Objective Observer Initiative** ](https://youtu.be/KtsCltgt4Cs?t=1979) Steve introduces this initiative as a framework for understanding societal constructs. He emphasizes that it can help form cohesive communities, providing insight into how AI can lead to both understanding and misconceptions. ![The Objective Observer Initiative Framework ](https://linkdigital.com.au/wp-content/uploads/2025/04/Diagram-The-Objective-Observer-Initiative-1.png)The Objective Observer Initiative Framework ![](https://linkdigital.com.au/wp-content/uploads/2025/04/Diagram-CKAN-API-Script-650x280px-1.png)CKAN API as shown at 48:50 timestamp ### [**\[00:49:38\]** – **Encouraging transparency in technology**](https://youtu.be/KtsCltgt4Cs?t=2978) The necessity for accountable data practices is emphasized in this section. Steven advocates for open systems that encourage experimentation beyond mere economic gain, aiming to create a more engaged and informed public. ### Watch the previous episodes of Tuesday Talks - Episode 01: [Investing in a data portal?](https://www.youtube.com/watch?v=iIiXBm53L9A&list=PLNYR4MdBNnu_50tgZti4Nmlon5AF7k6aL) - Episode 02: [Open data portals for climate resilience](https://www.youtube.com/watch?v=Mv1oYnSVXQ8&list=PLNYR4MdBNnu_50tgZti4Nmlon5AF7k6aL&index=2) - Episode 03: [A conversation on adopting open data standards (DCAT)](https://www.youtube.com/watch?v=Zo75ZMlhyj0&list=PLNYR4MdBNnu_50tgZti4Nmlon5AF7k6aL&index=3) - Episode 04: [AI, LLM, MLOps, Open Data, Data Management (Part 01) ](https://www.youtube.com/watch?v=joPvR37MB-E&list=PLNYR4MdBNnu_50tgZti4Nmlon5AF7k6aL&index=4) - Episode 04: [Artificial Intelligence, Machine Learning, Open Data (Part 02)](https://www.youtube.com/watch?v=P6KdKaNqj-M&list=PLNYR4MdBNnu_50tgZti4Nmlon5AF7k6aL&index=6) **Categories:** All articles, CKAN, Government, Higher Education/Research, Kate Sampher, Objective Observe Initiative, Open Data, Thought Leadership **Tags:** CKAN, CKAN API, Improve public trust, open data, Thought Leadership --- ### [How data dictionaries can help you understand your data better](https://linkdigital.com.au/news/2026/06/how-data-dictionaries-can-help-you-understand-your-data-better/) **Published:** June 18, 2026 **Author:** Andrew Nette **Excerpt:** Discover real-world uses, from sea ice data to Croissant formats, and how dictionaries support trustworthy, future-ready data. Read the article. **Content:** ![](https://linkdigital.com.au/wp-content/uploads/2026/06/Data-dictionaries-1024x535.jpg) What is a data dictionary and what are its benefits? This question was the subject of a recent presentation by [Ian Ward](https://www.linkedin.com/in/ianward/), one of our Senior Solutions Architects, as part of the Canadian Polar Data Workshop VI, co-hosted by the [Waterloo Climate Institute](https://www.linkedin.com/company/waterloo-climate-institute/) and the [Polar Data Catalogue Canadian Cryospheric Information Network](https://www.linkedin.com/in/pdcccin/) at the [University of Waterloo](https://www.linkedin.com/school/uwaterloo/). I spoke to Ian about his talk and how data dictionaries can help users better understand their data. ## **Defining a data dictionary** Ian defines a data dictionary as a file that is typically published alongside a dataset to provide users with the necessary information to interpret the data that you’re giving them – like a centralised reference guide that defines the structure, meaning, and rules of a specific dataset or database. “It can be anything from a CSV file that lists the individual columns and what they’re supposed to contain, or it could be a fully described [Croissant](https://mlcommons.org/working-groups/data/croissant/) file that includes provenance information and instructions on how to collect individual image files and make them correspond to tables in a database. The most important things are just titles and descriptions of what the data \[is\] that you’re publishing.” This is very similar to other forms of metadata, which is often used as the starting point of a data dictionary. A data dictionary “can go down to the individual columns or you can also have information about the controlled lists and things like that, but it really varies based on who the intended audience is. So, if you’re working in reproducible science, it’s going to be important that you have information about every single step that was involved in the production of that data. That would be an important part of your data dictionary. But for many users, just having clear titles and descriptions of the fields is still much better than looking at a plain CSV file.” ## **Who can benefit from a data dictionary?** In terms of who can benefit from a data dictionary, Ian maintains it is anybody whose going to be working with your data. “Because it means that if they are building systems that they can rely on the format that’s going to be published \[and\] they can see whether that format changes over time. Perhaps data that was published last year is going to be different than this year, and updating the data dictionary makes it clear that when they’re doing that integration that they need to account for that.” “But also, the people that are publishing the data can benefit as well. It forces you to think as a data publisher about exactly how you’re going to format things. And you might potentially think while you’re describing them, well, you know, maybe as a consumer, you know, this way of writing it might be better than another way.” One use case example given by Ian during his talk related to the [Canadian Watershed Information Network](https://canwin-datahub.ad.umanitoba.ca/fr/home) website – the sea ice levels on the Hudson Bay \[a large saltwater body located in northeastern Canada\]. “That’s one of their most important data sets and I went through a bunch of possible different ways of formatting a data dictionary for that type of dataset. And when you’re producing a dataset like that, it might be obvious things like the units that you’re using or what a code means for a particular location where a sample has been captured. So, you can say exactly what units you’re using, how a measurement is taken, and what the different codes that you see there actually correspond to in the real world.” Ian believes data dictionaries also have a role to play in helping to enable transparent future ready governments. “Everything is driven by the data that we’re publishing and being able to understand that is key to being able to turn that \[data\] into the outcomes that you’d like to see. Anybody that’s publishing and using data, which is almost everybody, can benefit from a clearer understanding of what’s being published and what’s being consumed.” Governments are increasingly turning to AI to improve services, anticipate citizen needs, and make faster, smarter decisions. But AI doesn’t work without high-quality data. “One of the formats that I was discussing was the Croissant format that was specifically designed for machine learning data because that data is often extremely large and formatted very differently than your more typical data set that you might see, maybe produced with Excel.” A data dictionary “allows you to tie together information like directories of files and tables in a way that you can then consume it with a system that would be used to train a language model.” “But on the other side, of course, these models are built using the data that we publish. So, clearly having a clear understanding of exactly what’s being published makes for much better training so that you can build the types of systems that you’re trying to do whether that’s with AI or with any kind of automated system.” ## **Want to talk about data dictionaries?** [Contact us here](https://linkdigital.com.au/get-in-touch/) and one of Link Digital experts will be in touch with you. **Categories:** All articles, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** CKAN, Data Dictionaries --- ### [Building the decentralised web: Why we're excited for the Solid 2026 Hackathon](https://linkdigital.com.au/news/2026/06/building-the-decentralised-web-why-were-excited-for-the-solid-2026-hackathon/) **Published:** June 15, 2026 **Author:** Kate Sampher **Content:** ![Solid Hackathon 2026 - Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/06/Building-the-decentralised-web-1024x535.webp) The future of the web hinges on a fundamental shift: putting users back in control of their own data. As strong advocates for transparent, user-empowered digital ecosystems, Link Digital is thrilled to endorse the upcoming **Solid 2026 Hackathon**, happening in Canberra from July 14–16, 2026. Co-hosted by the [ANU Software Innovation Institute,](https://sii.anu.edu.au/) the [Canberra Innovation Network](https://cbrin.com.au/), and the [Open Data Institute,](https://theodi.org/) this multi-day event centres on the SOLID protocol, an open W3C standard that allows individuals to securely store their data in decentralised Personal Online Datastores. ## Why this event matters As data sovereignty and digital trust become critical challenges for governments and organisations alike, we need practical, privacy-first solutions. The Solid 2026 Hackathon isn’t just for developers; it is an intentionally multidisciplinary event. Software engineers and data scientists will work side-by-side with designers, legal professionals, and data privacy specialists to prototype the next generation of web applications. Participants will get hands-on experience with Solid-based systems, receive mentorship from researchers and active practitioners, and help build a web where privacy is engineered by default. ## Join the movement Whether you are a seasoned developer already building on the decentralised web, or a privacy advocate wanting to see what user-controlled software looks like in practice, this event is an incredible environment to learn, collaborate, and ship something meaningful. At Link Digital, we believe deeply in the power of open standards and community-driven innovation to improve and reshape the data landscape. We highly encourage our network to get involved and lend their expertise to this important initiative. ## Event details - **Dates:** 14–16 July 2026 - **Venue:** Canberra Innovation Network (Level 5, 1 Moore Street, Canberra) - **Tickets:** [Available now via Eventbrite](https://www.eventbrite.com.au/e/solid-2026-hackathon-tickets-1989350161886) [**Read more and register for the hackathon here**](https://solidcommunity.au/hackathon-2026-article.html). **Categories:** All articles, Environmental/Climate Change, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data **Tags:** ANU Software Innovation Institute, Canberra Innovation Network, Open Data Institute, Solid 2026 Hackathon, SOLID protocol --- ### [A catalyst for thought: Pondering a new scientific paradigm for data observation and measurement](https://linkdigital.com.au/news/2026/06/a-catalyst-for-thought-pondering-a-new-scientific-paradigm-for-data-observation-and-measurement/) **Published:** June 10, 2026 **Author:** Steven De Costa **Content:** For much of the past year I have been wrestling with a question that began as a faint signal and has since grown into a central line of inquiry in my mind: the subtle but critical distinction that seems to underpin our entire data-driven enterprise: the boundary between *observation* and *measurement*. This reflection is based on my emergent belief that the scientific community may be so fluent in the language of data that we risk forgetting the profound act of translation that occurs when the world is turned into data. This act has deep ethical consequences, especially given the changes being wrought by the rapid growth of AI. ## The inalienable right to observe Observation is the bedrock of science. It is a primary faculty of a conscious agent: the natural, inalienable right to perceive the signals of the world, to witness a phenomenon, and to ask “Why?”. This fundamental freedom is the engine of all inquiry. Measurement, or what we might more accurately call *datafication*, is a different act altogether. It is the secondary, deliberate process of capturing, structuring, and recording an observation. It transforms a fleeting perception into a persistent, shareable, and analysable artifact: data. This is the moment a natural right is translated into a constructed asset, and it is here that the ethical landscape shifts entirely. A researcher observing a community, a sensor measuring atmospheric pressure, and a database holding a genomic record; these are not points on a frictionless continuum. They are distinct stages, each requiring its own ethical considerations and, crucially, its own layer of consent. One has a right to look through the microscope, but the act of creating a permanent, shareable image of what is seen requires a different and more specific agreement, especially when the subject is a person or a community. It is in this crucial moment of datafication that we have a blind spot. Our current frameworks are primarily concerned with the governance of data *after* it exists. We have not yet developed the language or the architecture to ethically manage the act of its creation. ## AI’s true and transformative paradigm The current discourse positions AI primarily as a tool for accelerating the existing scientific paradigm. It is seen as a technology that will optimise search and learning across vast, pre-existing datasets. [As Canadian computer scientist Professor Richard Sutton’s highly influential 2019 essay, ‘The Bitter Lesson](http://www.incompleteideas.net/IncIdeas/BitterLesson.html)‘ compellingly argues, general methods that leverage computation will inevitably outperform those based on domain-specific human knowledge. But this view frames AI as a competitor to human intellect, destined to render the researcher’s intuition obsolete. A ‘Brighter Lesson’ suggests a different, more collaborative path. The true transformative power of AI is not in its ability to analyse the data we have already collected, but in its potential to augment our capacity for observation and discernment before data is ever created. Imagine AI not as a data-crunching engine at the end of the pipeline, but as an ethically-bound co-observer at the very beginning. An AI that can can be a tool of incredible discernment, capable of identifying subtle patterns and signals in the world that a human might miss. Its role should be to *assist the observer*, not just to analyse the measurement. In this new paradigm, AI operates within a system of info-logical dynamics: 1. Assisted observation: An AI, with the explicit consent of the observer, can be tasked to watch over a specific context. 2. Discernment as a service: Its primary function is to identify events of interest based on pre-agreed rules and ethical principles. 3. Sovereign datafication: Only when a meaningful event is discerned does the system, with consent, *datafy* the observation. Crucially, this newly created data asset belongs, by default, to the subject of the observation. It is their sovereign property. This model moves AI from the back office to the field, transforming it from a mere analyst into a trusted instrument of perception. ## An architecture for a new scientific renaissance This vision is not a theoretical fantasy. The technical components to build this future exist today. The Solid protocol, a web decentralisation protocol initiated by [Sir Tim Berners-Lee](https://en.wikipedia.org/wiki/Tim_Berners-Lee), provides the concept of a ‘digital domicile’ or Personal Online Data Store (POD), where individuals can hold their own data with sovereign control. In this model, a research subject’s data, be it genomic, social, or environmental, resides in their own secure POD. The CKAN-powered open-data platform can be applied to serve not only as a repository of raw data, but as a public transparent registry of machine-readable agreements that govern how data in sovereign PODs can be accessed, used, and observed. This is the paradigm shift: from centralised data repositories to a decentralised ecosystem of sovereign agents who grant revocable access to trusted researchers. It embeds the rights of the individual into the very architecture of the scientific process. It creates a high-trust environment where the immense power of AI discernment can be harnessed without sacrificing agency. The scientific community has always been the vanguard of progress. It has a historic opportunity to lead not just in technical innovation, but in pioneering the social and ethical frameworks that will define the coming info-logical age. By drawing a bright line between observation and measurement, and by re-imagining AI as a partner in perception, we can build a future where data empowers everyone, starting with the very subjects of our essential and unending observation of the universe. **Categories:** Artificial Intelligence, Objective Observe Initiative, Steven De Costa, Thought Leadership **Tags:** Artificial intelligence, CKAN, data creation, data observation, Personal Online Data Store, Richard Sutton, Tim Berners-Lee --- ### [CKAN Insider #5: How Ask AI fixes broken discovery for users](https://linkdigital.com.au/news/2026/06/ckan-insider-5-how-ask-ai-fixes-broken-discovery-for-users/) **Published:** June 2, 2026 **Author:** Andrew Nette **Content:** One topic that we have touched on throughout the CKAN Insider series is how AI is changing the way people interact with data. For CKAN Insider #5, I talk to one member of the Link Digital team who is directly working on this issue, Oleksandr Cherniavksy. Oleksandr is a Full Stack Developer at Link Digital and one of our CKAN experts. He has also been a key player in the design of our new Ask AI feature – an AI-powered layer on top of CKAN that lets users query CKAN data portals using natural language. In the final instalment of the CKAN Insider series, Oleksandr discusses what is broken about the discovery experience on many data portals, and how our new Ask AI feature can help fix the situation. ## **You shouldn’t have to be a data expert to use a portal** While open data portals have matured significantly over the past decade, with many organisations now operating CKAN instances containing hundreds, if not thousands of datasets, Oleksandr maintains something is broken about the discovery experience on many of them. Specifically, the friction users experience when searching through large volumes of datasets without knowing specific keywords. “Most data portals are built for people who already know what they are looking for. If you are visiting a data portal, and it has, for example, one thousand data sets or ten thousand data sets, and you don’t know exactly what you are looking for, you have a few key words, but you can’t find the text that represents your key word. You \[also\] tried a search, and it didn’t return any results. So, this is sometimes a bit of a lottery when you try to find something.” This situation is especially true for a regular person who is trying to find data but does not know anything about the specifics of the data portal they are on. There is also an issue with browsing. “If you are looking for something inside thousands of data sets, browsing won’t help you. You can’t do it.” The limitations of manual scrolling and exact keyword matching motivated Link Digital to create its new ‘Ask AI’ feature. It understands not key words but semantic similarity in searching and marks the words that are somehow similar in a search, in such a way as to interpret user intent and group related concepts like ‘auto’ and ‘car’. ## **How Ask AI works** Ask AI introduces an AI-powered layer on top of CKAN to address this gap. The goal is straightforward: to make data portals conversational, contextual, and semantically searchable. “Imagine that you have a dataset. We read it carefully and programmatically and transform it into some kind of unique fingerprint that this dataset has. And when a user searches, we do the same thing with the user’s search query. We transform it into a fingerprint and then compare those two fingerprints and say that this query search looks like this fingerprint of a data set, and then we have a result.” If you query “Ask AI “what is this data set about or can you find me datasets related to this topic, the application will do exactly the same. It will just take the query, hook into the storage that holds all the information and retrieve the results.” Oleksandr also emphasises that Ask AI: - Relies on local hardware, such as the GPU and CPU, rather than cloud-based large language models. - Can assist in filling out or improving metadata for datasets. - Can interact with different file formats. For PDF resources, the tool provides a summary of the content, including information on individual fields and imagery. For CSV files, the feature provides data set summaries based on available metadata and allows for table previews (although how comprehensive the responses are, depends on the metadata provided for the dataset in question). - Has the capacity to build charts and graphs based on real data requests. Users have the option to download these generated charts as images or export the underlying chart data in CSV format. ## **The importance of data security** Ask AI also addresses another major concern for many organisations and government agencies, data sovereignty. ![Data sovereignty with CKAN](https://linkdigital.com.au/wp-content/uploads/2026/06/50f6e9415e145d05f5311e276b85c914-scaled-1024x576.png)*Data Sovereignty – Link Digital with Ask AI* Ask AI [uses local models such as Ollama](https://ollama.com/) and stores vector data within a PostgreSQL database. “This is very important for data sovereignty, when you understand that all your information stays inside your local network and, for example, the vector database, also lives in your environment because we are using an extension for the Postgres database. When you create so-called fingerprints you use a local small language model, and you store it in the local database environment.” ![Local AI with Ollama - Link Digital with Ask AI](https://linkdigital.com.au/wp-content/uploads/2026/06/0ee98d21343c371b781297a2de98b388-scaled-1024x576.png)*Local AI with Ollama – Link Digital with Ask AI* “We can plug in different providers. We have implemented the support only for Open AI now, but we want to look at the client’s response and what they need, but it is totally doable for different solutions like Anthropic.” Ask AI also respects CKAN’s existing permission labels to ensure that users only access data they are authorised to view. “When you, for example, ask something about the datasets \[or\] searching datasets, you are using CKAN permission labels. Each dataset has its permission labels. If , for example, it is a public dataset, you have a permission label called public. If it is a dataset that is not public but private, it will have a permission label that is private and that says that only, for example members of a certain organisation can use it. And when users ask a question or search something, we calculate the permission label for the specific user. So, even here, we are not showing any results that users shouldn’t see.” “If a user does not have access to a dataset, it is neither retrieved nor referenced in responses. When deployed with local AI models, data remains entirely within organisational infrastructure. For institutions with strict data residency requirements, this is a critical capability.” You can [watch the full interview](https://www.youtube.com/watch?v=7gG0Zq90EvE) with Oleksandr, which includes [his demo of the Ask AI feature here.](https://youtu.be/7gG0Zq90EvE?t=277) If you’d like to learn more about how we can support your data portal to better integrate with modern AI technologies, [message Link Digital here](https://linkdigital.com.au/get-in-touch/). **Categories:** Artificial Intelligence, CKAN, Government, Open Data **Tags:** Ask AI, CKAN, CKAN extension, data portal, open data --- ### [CKAN Insider #4: Developer talks about 2.12 upgrade and taking stock on the road to CKAN 3.0](https://linkdigital.com.au/news/2026/05/ckan-insider-4-developer-talks-about-2-12-upgrade-and-taking-stock-on-the-road-to-ckan-3-0/) **Published:** May 25, 2026 **Author:** Andrew Nette **Excerpt:** The 2.12 upgrade contains significant improvements that portal maintainers should know about. **Content:** Based in Kharkiv, Ukraine, [Sergey Motornyuk](https://github.com/smotornyuk "Sergey Motornyuk") is one of Link Digital’s Senior Solutions Architects. He has been involved in the [Comprehensive Knowledge ](https://ckan.org/)[Archive](https://ckan.org/)[ Network](https://ckan.org/) (CKAN) ecosystem for over a decade and is a core member of the CKAN Tech Team. He has a very hands-on and in-depth understanding of the CKAN platform’s evolution and where it needs to go to stay relevant. For CKAN Insider #4, I spoke to Sergey about how the software has changed over the last decade, what the current upgrade path to CKAN 2.12 looks like, and what the next major upgrade – CKAN 3.0 – will mean for organisations running data portals? ## **From small publishing platforms to a complex open data ecosystem** In the early days, according to Sergey, most organisations used and operated CKAN data portals mainly as small publishing platforms, to which they uploaded data sets. “The biggest change from my point of view is how organisation governments look on their portals and which function they expect from \[the CKAN \] ecosystem. Basically, instead of just static catalogue, portals have turned into complex systems with API integrations, with analytical tools, with just spatial previewing, etc.” Another major change relates to CKAN’s “stability and scalability”. Ten years ago, deployments often required a significant amount of manual labor and maintenance. “Today CKAN is much more advanced and mature in terms of extendibility, etc. It’s compatible with cloud ecosystems. It has solid security practices. Now almost everything in CKAN can be automated and it almost requires no manual labor at all. It \[CKAN\] can be deployed just in a few clicks and it’s really impressive.” ## **CKAN 2.12** Sergey is currently involved in preparations for the release of CKAN 2.12, the final release in the 2 series, before the next major software upgrade, CKAN 3.0. The 2.12 upgrade contains several significant improvements that portal operators should know about. ![CKAN 2.12 file management - Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/05/img-2.12-file-management-1024x561.png)Update on File Management as mentioned in CKAN Insider #4 “It has a lot of wonderful things, but probably one of the most important is the fact that we move away from legacy technologies and huge technical debt, and now anyone who upgrades to CKAN 2.12 will be able to jump into version three with the least possible amount of effort.” ![CKAN 2.12 datastore performance](https://linkdigital.com.au/wp-content/uploads/2026/05/img-2.12-datastore-performance-1024x561.png) “Previous versions of CKAN often relied on some old or even unsupported libraries just because we had no capacity to update it. In version 2.12, absolutely every library is updated to the latest available version.” ![CKAN 2.12 advanced datastore filtering](https://linkdigital.com.au/wp-content/uploads/2026/05/img-2.12-advanced-datastore-filtering-1024x561.png)Advanced Datastore Filtering as mentioned in CKAN Insider #4 Other important features include improved search engine support, performance enhancements for the CKAN Datastore, and changes in the file management ecosystem for simplified cloud storage communication. Sergey stresses that an exact go-live date for CKAN 2.12 is coming soon. The process is community-driven and depends heavily on final testing and coordination among contributors. “Basically, we have two issues, both are related to [DataStore](https://docs.ckan.org/en/2.9/maintaining/datastore.html "DataStore"), and they are connected to some security and performance issues. As soon as we are done with them, we will need like an extra week just to properly test and bundle everything and it will be published.” ![CKAN 2.12 security and modern libraries](https://linkdigital.com.au/wp-content/uploads/2026/05/img-2.12-security-and-modern-libraries-1024x574.png)Security updates as mentioned in CKAN Insider #4 ## **Countdown to CKAN 3.0** A key focus of CKAN 3.0 will be the removal of old, duplicated, or slowed-down elements from the CKAN core to enable future development. “There are still some either old or duplicated things that slow down the development, and we want to rip them out of CKAN core and remove everything that blocks us from even further development.” While there may also be work undertaken to change some API compatibility level issues, ideally, the migration from CKAN 2.12 to 3.0 should be a smooth process, potentially requiring only about a day of development effort. Sergey also anticipates a lot of effort will be put into modernising the front-end architecture and making the platform easier to extend and maintain for the next decade. While CKAN 3.0 is still some time off, Sergey states that there are things that organisations that use CKAN can do now to prepare. “Many portals have accumulated tons of custom code and it’s a good moment to evaluate whether all these customisations are still necessary.” Organisations should also “review their code to ensure it follows the [best practices recommended by CKAN](https://docs.ckan.org/en/latest/contributing/index.html), making sure their custom code is modern and compliant.” ## **A long-term project, not a short-term sprint** According to Sergey, the most common mistake organisations make involves treating their CKAN portal as a one-time project instead of a long-term, living ecosystem that requires continuous maintenance. “A CKAN portal always requires maintenance. When \[a\] new version is released, ideally the portal must be upgraded but even without it \[there must be\] periodic checks of dependencies, of metadata quality management. Everything must be in place or else the portal will just accumulate a huge amount of unreliable data, and no one will just use it.” Another common mistake is excessive customisations without putting a long term plan in place behind them. “Custom features can solve immediate problems but over time they really make upgrades significantly more difficult and that also correlates with my mention of best practices. Basically, whenever a custom feature is implemented, it should be aligned with CKAN recommendations, and every new version should be checked against this feature because sometimes it becomes possible to write the feature better.” ## **Staying relevant in the face of major challenges** Sergey is adamant that the global community around CKAN is one of its greatest strengths. “A single maintainer cannot really solve all the problems and all the challenges, and data management can benefit from a diversity of governments, universities, non-governmental agencies and independent developers around the world. They have their own way to manage data to publish data. They discover they have different priorities and experience, and that diversity and experience tends to make the platform more robust. The community creates this transparency and resilience. Organisations… can also affect the road map of CKAN and make it more suitable to their needs.” Another major benefit of this community is knowledge sharing. “The global community \[has\] accumulated years of operational experience across hundreds or maybe even thousands of portals globally and sharing this experience can help everyone to avoid the same mistakes and move further in building an ideal portal.” But on the occasion of CKAN’s 20th anniversary, Sergey sees challenges, as well as opportunities, ahead. “I think that CKAN needs to continue evolving from a mere data catalogue into \[a\] broader data discovery platform. AI is changing how exactly people interact with information. Users expect, maybe demand, the availability of semantic search, automated metadata generation, and maybe a chat-like interface where they can communicate with the portal itself to discover something and probably integration with some advanced analytical systems or models.” CKAN manages valuable, structured, and trustworthy public data, which is an asset for AI systems. He believes future focus areas should include improving metadata quality and interoperability, supporting AI-assisted discovery, and making the API more structured and supportive of machine-readable formats. [Watch the full interview with Sergey here on our YouTube channel.](https://youtu.be/ya3fXIINgAU) --- [Link Digital](https://linkdigital.com.au/) team provides CKAN managed hosting and consultation. Reach out to [start your 2.12 upgrade.](https://linkdigital.com.au/get-in-touch/) **Categories:** All articles, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Government, Higher Education/Research, Industry, Internal data hub, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** CKAN 3.0, CKAN community, data portal, open data, Open source technology --- ### [Planning a Drupal upgrade in 2026? Here is what you need to know](https://linkdigital.com.au/news/2026/05/planning-a-drupal-upgrade-in-2026-here-is-what-you-need-to-know/) **Published:** May 6, 2026 **Author:** Kate Sampher **Content:** [The content management software known as Drupal](https://new.drupal.org/home) powers a significant share of the websites run by governments, universities, and international organisations. It’s stable, secure, and built on open standards. But like any platform, it has a release cycle, and 2026 is shaping up to be a pivotal year for anyone still running older versions. If your site is on Drupal 7, Drupal 10, or any release in between, now is the time to plan your next move. Here’s what you need to know to do it successfully. ## **Drupal 7 is already unsupported** [Drupal 7 reached its official end of life on 5 January 2025](https://www.drupal.org/about/announcements/blog/drupal-7-has-reached-end-of-life-psa-2025-01-06), after 14 years in service. [The Drupal Association](https://www.drupal.org/association "The Drupal Association") and the Drupal Security Team no longer release security advisories, patches, or compatibility updates for it. If you are still running Drupal 7, your site is prone to issues. For organisations subject to compliance frameworks such as PCI, HIPAA, SOC 2, or FedRAMP, running unsupported software can create more than a security problem,[ ](https://www.drupal.org/about/drupal-7/d7eol/partners)[](https://www.drupal.org/about/drupal-7/d7eol/partners)[it can create a compliance problem](https://www.drupal.org/about/drupal-7/d7eol/partners). There is no direct upgrade path from Drupal 7 to modern Drupal. Moving forward means rebuilding the site on the latest Drupal codebase, migrating your content, and reimplementing custom functionality. It is a project you should be scoping now, not later. [*Also read: Drupal – why organisations should use it as part of their open data management.*](https://linkdigital.com.au/news/2024/10/drupal-why-organisations-should-use-it-as-part-of-their-open-data-management/) ## **Drupal 10 is next in line** [Drupal 10 will reach end of life on 9 December 2026](https://www.drupal.org/about/core/policies/core-release-cycles/schedule), a fixed date set by the Drupal core release managers. That gives teams on Drupal 10 roughly eight months to plan and execute an upgrade to Drupal 11. The jump from 10 to 11 is far more manageable than a Drupal 7 migration. Drupal 10 and 11 share a continuous upgrade path, provided your site is on Drupal 10.3.0 or later release, and provided your contributed modules and themes already have Drupal 11 compatible releases in place. The [](https://drupalize.me/tutorial/upgrade-drupal-11)[Drupal upgrade documentation](https://drupalize.me/tutorial/upgrade-drupal-11) sets out the full checklist. ![Drupal 10 vs Drupal 11 Requirements Comparison](https://linkdigital.com.au/wp-content/uploads/2026/05/Planning-a-Drupal-upgrade-2-1024x535.webp)## **Drupal 12 is on the way** [The Drupal core team is currently targeting the release of Drupal 12 for the week of 10 August 2026](https://www.drupal.org/about/core/blog/help-us-reach-drupal-12s-second-release-window-in-august), with a beta deadline of 15 May 2026. If that deadline slips, the fallback window is the week of 7 December 2026. A word of caution for anyone tempted to skip ahead. While Drupal 12 is targeted for release in 2026, there is always a lag before major contributed modules become compatible. For existing sites, a Drupal 12 upgrade is probably not feasible until at least early 2027. Furthermore, Drupal does not support leapfrogging major versions. You cannot jump from Drupal 10 straight to Drupal 12. Each major version must be passed through in sequence, which is another reason teams still on Drupal 10 should be planning their Drupal 11 upgrade now. ## **What a Drupal upgrade actually involves** Every Drupal upgrade is different, but most projects share the same shape. We start with an audit of your core, contributed modules, and custom code, typically using the [Upgrade Status module available on Drupal.org](https://www.drupal.org/project/upgrade_status). From there, the work usually includes bringing your site to the latest minor release of your current major version, updating or replacing any modules that are not yet compatible with the target version, reviewing configuration, refactoring any deprecated APIs, and rigorous testing across development, staging, and production environments before cutover. For government and public sector sites, the stakes are higher. Downtime, accessibility, and continuity of citizen services all need to be factored into the plan, not bolted on at the end. ## **Get ahead of the deadline** Link Digital has been delivering [](https://linkdigital.com.au/drupal/)[Drupal development and managed hosting](https://linkdigital.com.au/drupal/) for government agencies, universities, and international organisations for more than two decades. We have migrated Drupal 7 sites to modern Drupal, upgraded Drupal 10 sites to Drupal 11, and provided ongoing support so our clients are never caught out by an end-of-life deadline. If you are weighing up a Drupal 7 rebuild or a Drupal 10 to 11 upgrade, we can scope the work, assess your module dependencies, and deliver a migration plan built around the December 2026 deadline. [Message Link Digital](https://linkdigital.com.au/get-in-touch/) today to talk through your options. **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Government, Higher Education/Research, Non-profit/NGO, Open Data, Technology Infrastructure **Tags:** CKAN, Drupal, open data management, Open source technology --- ### [How Link Digital is making open data 'more' AI ready](https://linkdigital.com.au/news/2026/05/how-link-digital-is-making-open-data-more-ai-ready/) **Published:** May 20, 2026 **Author:** Andrew Nette **Content:** ![Link Digital and open data](https://linkdigital.com.au/wp-content/uploads/2026/05/Three-ways-Link-Digital-is-helping-to-make-open-data-more-AI-ready-1024x535.webp)A lot has been written, including on this site, about the challenges posed by the rapid rise of AI for the open data ecosystem. But at [Link Digital](https://linkdigital.com.au/) we don’t just want to talk about this. We are doing something about it. We have two decades of experience building data management solutions for a wide range of clients globally, using the [Comprehensive Knowledge Archive Network (CKAN)](https://ckan.org/) and other open source tools. Our core mission remains empowering our clients to make meaningful change with their data. But now we are using our extensive experience to think differently about how to make open data infrastructure more effective in the face of advances in machine learning. This means developing open source tools that not only make data management more AI-ready but also ensure it’s done in a secure and ethical way. Here is a brief overview of three ways that Link Digital is currently helping to do this. ## **Ask AI: a new extension for CKAN-based data portals** You will have heard the term ‘agentic’ now being used a lot in relation to how data portals are evolving. In short, agentic portals incorporate AI agents to understand, manipulate, and act upon the data on a user’s behalf. While much of this functionality is still in development, one area that Link Digital has worked on is the incorporation of natural language or semantic search interaction into our open data portals and catalogues. In a traditional portal, users rely on key words to find a dataset. By using semantic understanding, portals don’t just use filenames; they understand the context of the data. This relates to what data specialists [Dr. Stefaan Verhulst and Adam Zable described in a recent article](https://rebootdemocracy.ai/blog/statgpt-fourth-wave-open-data) as “a broader paradox at the heart of contemporary data governance: data may be open, yet it remains functionally inaccessible for many intended users.” In other words, many organisations now sit on such large data collections that it becomes too hard to use by non-technical or expert staff, let alone interested members of the public. Lowering the barrier to the effective use of data portals by allowing users to get expert level insights without needing to be data scientists, lies behind [Ask AI, a new CKAN extension by Link Digital](https://linkdigital.com.au/ask-ai/). Rather than struggling to locate the right dataset when they are not clear about the exact terminology they are searching for – and having to manually inspect metadata and download files they may not need or want to understand the structure – Ask AI uses semantic similarity to help users search. Instead of matching words, it matches meaning. Behind the scenes, dataset and resource metadata – along with supported document content – are converted into vector embeddings and stored in PostgreSQL using an extension called [pgvector](https://github.com/pgvector/pgvector). When a user performs a search, the system retrieves results based on semantic proximity rather than simple text overlap. For organisations managing large portals this is a game changer in terms of improving dataset discoverability without requiring publishers to change data workflows. And to ensure accuracy, every AI generated answer provides a direct link to the source dataset. It makes the data on CKAN-powered portals more findable and, thus, more accessible, and users do not need to be data scientists to understand their search results. Importantly, while the Ask AI feature enables users to interact with a data catalogue or portal more like they’re interacting with ChatGPT, it does so without sacrificing security. This is because Ask AI can be configured in such a way that sensitive data remains within a secure infrastructure and proprietary information is never used to train public models like ChatGPT or Gemini. It enables a data manager to define exactly which datasets the AI can access and who is authorised to query them. This means the AI cannot guess or make up facts as it is tethered to the trusted datasets in your portal. [*You can find out more about Link Digital’s Ask AI feature here.*](https://linkdigital.com.au/news/2026/03/what-is-the-future-of-open-data-in-the-ai-era/) ## **Machine readable multilingual metadata** The MLCommons is an open engineering consortium dedicated to improving AI systems by developing standardised benchmarks and large-scale open datasets. [Earlier this year they released Croissant 1.1](https://mlcommons.org/2026/02/croissant-1-1-standard/), a new high level metadata format for machine learning datasets designed to make open datasets on CKAN easier to discover, use, and integrate with machine learning tools and platforms. Before Croissant 1.1, AI models often struggled to understand the datasets hosted on CKAN because the descriptive metadata was meant for humans, not machine learning pipelines. The work of MLCommons means that any dataset can now be automatically translated into a format for AI tools to understand instantly without manual cleanup. [Link Digital has been an active participant in the Croissant 1.1](https://linkdigital.com.au/news/2026/02/link-digitals-contribution-to-croissant-1-1-expands-ai-researchs-global-reach-with-multilingual-metadata/) working group and the efforts of one of our designers were key to the implementation of multilingual metadata support. By enabling datasets to hold labels and descriptions in multiple languages at the same time, this update ensures that global data portals can speak the same language – making AI research more inclusive and accessible globally. This is a small but vital contribution to meeting the much larger challenge caused by the fact that most of the world’s most powerful AI has been built using data labelled in English and, thereby. While Large Language AI models (or LLMs) are getting better at providing multilingual tools, this is no substitute for having the actual version of the language instead of having a tool that will do the translation for you. A major step forward in democratising the technology. ## **The Objective Observer Initiative: An ethical framework for AI** The [Objective Observer Initiative ](https://linkdigital.com.au/news/2026/02/the-objective-observer-initiative-and-the-challenge-of-being-fully-open/)(OOI) is a new capability being developed by Link Digital. While tools like Croissant and Ask AI can make a vital contribution to the ‘how’ of machine readability, by improving facets such as discoverability and metadata, OOI is focused on ethical issues involved in developing more trustworthy models. In the past, open data simply meant the file was available for download. Link Digitals posits that in an AI world, making data open, while vital, is not enough because AI can’t easily distinguish between high-quality facts and ‘hallucinated’ or biased data. In addition to sharing data, Link Digital believes that what is needed is ‘verifiable honesty.’ The OOI does this by focusing on the ‘signals’ in data. In a CKAN context, this means adding metadata that doesn’t just describe the columns but declares the intent of the data creator. When AI reads a dataset, it can use this additional data to verify whether that data is honest, unbiased, and fit for purpose. It can also check it to see if a dataset’s observed outcomes match its stated intent of the individual or organisation that uploaded the dataset This differs markedly from the main measurement of satisfaction currently in place in relation to engagement with digital platforms, clicks, and efficiency as the only signal for consent. The current situation relies on feeding data into opaque machine learning tools and passively receiving the results that emerge on the other side. Changing this has the potential to turn CKAN from a simple repository into a more fundamental source of truth for responsible AI. While the [OOI is still in development](https://linkdigital.com.au/link-lab/) it is already influencing Link Digital’s work with data portals. As Link Digital’s Executive Director put it in a recent interview: “There is an opportunity to co-construct datasets that provide optimistic signals. Such datasets would naturally be made discoverable on portals such as those we develop and maintain for our clients using CKAN, Drupal and other open technologies. “ [*You* ](https://linkdigital.com.au/news/2026/02/the-objective-observer-initiative-and-the-challenge-of-being-fully-open/)[*can read more about the OOI on our site here*](https://linkdigital.com.au/news/2026/02/the-objective-observer-initiative-and-the-challenge-of-being-fully-open/)[*.*](https://linkdigital.com.au/news/2026/02/the-objective-observer-initiative-and-the-challenge-of-being-fully-open/) Greater discoverability, multilingual metadata for machine learning datasets, and a more transparent and ethical model of AI. Link Digital is not just talking about how the open data ecosystem can meet the challenges of AI, we are helping it to do so. **Categories:** All articles, Artificial Intelligence, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Government, Higher Education/Research, Internal data hub, Non-profit/NGO, Objective Observe Initiative, Open Data **Tags:** CKAN, data portal, open data, Open source technology --- ### [How to navigate CKAN user interface (UI) screens for non-programmers](https://linkdigital.com.au/news/2026/05/how-to-navigate-ckan-user-interface-screens-for-non-programmers/) **Published:** May 20, 2026 **Author:** Brett Jones **Content:** In this article, I’m going to walk you through how I navigate some of the CKAN user interface (UI) screens in a very simple way. This is just a quick intro for people who want a little help getting started with the basics. ### **Setting up the environment** I have CKAN running within a Docker environment using a local stack on my Mac OS machine. When I start, my containers are down, but the images, volumes, and networks are all installed and ready to go. To get things moving from the command line: - **Build the environment:** I run docker-compose build first just to make sure everything is ready. It usually checks the images very quickly. - **Start the containers:** I run docker-compose up to start all the containers. - **Monitor initialisation:** You’ll see color-coded initialisation logs in the terminal as each component starts. **Verify the stack:** I wait until the key containers—DataPusher, DB, Redis, Solr, and CKAN—are up. Finally, once NGINX is up, the system is ready for the browser. \[Login to the CKAN instance\] ![A screenshot of CKAN instance](https://linkdigital.com.au/wp-content/uploads/2026/05/image-1024x786.png)A screenshot of CKAN user interface (UI) instance ![A screenshot of a CKAN Instance - My Organizations](https://linkdigital.com.au/wp-content/uploads/2026/05/image-2-1024x808.png)A screenshot of a CKAN Instance – My Organizations ### **Organising data with organizations and datasets** Once I’m logged in as an admin (ckan\_admin), I can start managing data. I like to use **Organizations** to keep things organised. For example, I’ve set up two: “Pigeonorg” and “Starlingorg”. #### **Adding a new dataset** If I want to add data to an organization, like “Starlingorg,” here is the process: 1. **Add Dataset:** Navigate to the organization and select “Add Dataset”. 2. **Name it:** I’ll call this one “Staff”. 3. **Visibility:** I usually set this to “Public” for my tests. 4. **Add Data:** You can link directly to a URL if you have a CSV file available on the internet. 5. **View Results:** Once created, CKAN gives you a view of the raw data, like a five-line CSV file, directly in the UI. #### **The DataStore and Datapusher extension** CKAN uses a **DataStore** to house this information. When you add a resource, the **Data Pusher** container works behind the scenes to push those entries into the database. You can check the DataStore tab to verify that the lines were successfully pushed. \[There will be details (logs) of the resource being either successfully or unsuccessfully imported into the CKAN DataStore\] ![A screenshot of CKAN DataStore](https://linkdigital.com.au/wp-content/uploads/2026/05/image-3-1024x657.png)A screenshot of CKAN DataStore ### **User management** You can manage users from the command line, but it’s also easy to do through the UI. #### **Registering a new user** To register a new person, I navigate to the /user/register URL while logged in as an admin. - I’ll provide a username (like “CKAN\_User2”) and an email address. - After creating the account, that new user can log in independently. ![Register for an Account - CKAN](https://linkdigital.com.au/wp-content/uploads/2026/05/image-4.png)Register for an Account – CKAN #### **Promoting to sysadmin** By default, new users don’t have full permissions. To make someone a **sysadmin**: 1. Go to the sysadmin management screen. 2. Choose the user you want to promote from the list. 3. Once promoted, they will appear in the official list of admins for that CKAN instance. I hope these simple steps help get you going with CKAN. --- Does your team need experts to update your CKAN portal? [Message Link Digital.](https://linkdigital.com.au/get-in-touch/) Read more tutorials from Brett Jones [here](https://linkdigital.com.au/news/author/brettjones/). **Categories:** All articles, CKAN, Resources, Technology Infrastructure, Tutorial **Tags:** CKAN, CKAN community --- ### [How to install CKAN 2.11 using Docker on Mac with OrbStack](https://linkdigital.com.au/news/2026/05/how-to-install-ckan-2-11-using-docker-on-mac-with-orbstack/) **Published:** May 7, 2026 **Author:** Brett Jones **Excerpt:** An easy-to-use guide on how to install and run CKAN using Docker on a Mac with OrbStack, an efficient and lightweight alternative to Docker Desktop. **Content:** ## **Introduction to CKAN and Docker on Mac** If you’re a developer or data enthusiast looking to run the [Comprehensive](https://ckan.org/)[ Knowledge Archive Network](https://ckan.org/) (CKAN) data repository platform on your Mac, using [Docker](https://linkdigital.com.au/news/2024/05/create-a-new-ckan-development-environment-and-install-a-new-extension/) is one of the best ways to manage the environment. However, traditional Docker Desktop apps can be resource-heavy, slowing down your machine. This guide walks you through a streamlined way to install and run CKAN using [OrbStack](https://orbstack.dev/), a lightweight Docker management tool optimised for Mac, especially those with the Apple Silicon M2 chip. ![How to install CKAN 2.11 using Docker on Mac with OrbStack](https://linkdigital.com.au/wp-content/uploads/2026/05/How-to-install-CKAN-2.11-using-Docker-on-Mac-with-OrbStack-1024x535.webp)## **Why use OrbStack instead of Docker Desktop?** ### **Heavy resource usage of Docker Desktop** Docker Desktop, while popular, can put a significant load on your central processing unit and memory, particularly on Macs with limited resources. Many users find their systems grind to a halt during heavy container builds or when multiple images are running. ### **Orbstack: a lightweight alternative** OrbStack offers an efficient way to run Docker containers without the bloat. It integrates well with macOS, supports Apple Silicon processors natively, and provides a clean, user-friendly interface to manage containers, volumes, images, and networks without taxing your system. This makes it ideal for running complex stacks like [CKAN](https://linkdigital.com.au/ckan/) with better performance. ## **Prerequisites for Installing CKAN on Mac with OrbStack** Before starting, ensure you have the following: - A Mac with Apple Silicon (M1 or M2) or Intel processor - macOS updated (This tutorial is tested on 2023 Mac Mini with macOS 26.3.1 -Tahoe) - Terminal app (default macOS Terminal works fine) - Visual Studio Code (VS Code) or any text editor for editing Docker compose files - OrbStack installed (free version available with optional Pro trial) - Basic familiarity with Docker and command-line operations ## **Step-by-step Guide to installing CKAN using Docker and OrbStack** **1. Setting up Orbstack on your Mac** Download and install OrbStack from the official website. Once installed, open the OrbStack app to familiarise yourself with the interface. You will see tabs for containers, volumes, images, and networks. **2. Preparing the CKAN Docker Repository** Download the latest CKAN Docker repository. At the time of writing, CKAN version 2.11 is current, with 2.12 expected soon. Extract the files and open the directory in VS Code or your preferred editor. **3. Configuring Docker Compose for Apple Silicon** In this tutorial, I use Apple’s M2 chip, I specified the platform architecture in the Docker Compose file to avoid compatibility issues. Add the following line directly under the CKAN service in your docker-compose.yaml file: ``` ckan: platform: linux/amd64 build ... ``` This ensures that the containers run under the AMD64 architecture, which is compatible with the CKAN images. **4. Creating the environment file** Create your .env file by copying the example provided in the repository: Shell ``` cp .env.example .env ``` Edit this file if needed to set environment variables such as ports, passwords, or paths. **5. Building Docker images** Open Terminal and navigate to the CKAN directory. Run the following command to build all required images: Shell ``` docker compose build ``` This process will compile the database, EngineX, and other necessary images for the CKAN environment. **6. Starting containers and pulling additional images** Run the containers with: Shell ``` docker compose up -d ``` This command pulls required images like Solr Radius and Data Pusher and starts the containers in detached mode. Be patient, as pulling images might take a few minutes, depending on your internet speed. **7. Monitoring Containers in OrbStack** Open OrbStack and navigate to the Containers tab. You should see containers for CKAN services starting up, including the database, Nginx, Data Pusher, and Solr Radius. OrbStack also shows volumes and networks created automatically. **8. Initialising the CKAN environment** Wait for Data Pusher and CKAN to initialise fully. The EngineX container starts last after the other containers are ready. You can view logs in OrbStack or via terminal to verify that services are running without errors. ## **Accessing and using CKAN on your Mac** **1. Accessing the web interface** Once the containers are running, open your browser and navigate to: ``` https://localhost:8443 ``` You may encounter a security warning due to the self-signed SSL certificate. Proceed by accepting the risk (this is normal for local development). **2. Logging into CKAN** Use the default admin credentials (set in your .env or Docker Compose file) to log in. **3. Creating an organisation and adding datasets** - Create a new organisation, e.g., “TestOrg” - Add a dataset, for example, “Testset1” and mark it public or private as needed - Link a URL to a CSV file containing dataset information **4. Uploading and viewing data** CKAN automatically parses the CSV headers and imports data into the database. You can monitor progress via logs. For example, uploading a 20,000+ row dataset should complete smoothly, confirming that your setup is working correctly. ## **The benefits of running CKAN with OrbStack on Mac** ### ***Open source and cost free*** CKAN is fully open-source, and using OrbStack’s free tier means no licensing fees or hidden costs. ### ***Lightweight and efficient*** OrbStack’s design minimises CPU and memory usage compared to Docker Desktop, leaving your Mac responsive during Docker operations. ### ***Easy to install and configure*** With straightforward Docker Compose files and minimal edits needed for Apple Silicon compatibility, setup is quick even for users new to Docker. ### ***Robust container management*** OrbStack’s interface simplifies monitoring, starting, stopping, and logging containers, volumes, and networks. ## **Here are the common issues I encountered and here’s how to fix them** 1. **Issue 1: Docker Compose build fails on M2 Mac** - **The fix:** Ensure you specify platform: linux/amd64 in your Docker Compose file under the CKAN service to force compatibility. 2. **Issue 2: SSL warning in browser** - **The fix:** This is expected for local self-signed certificates. Accept the warning or add exceptions in your browser. 3. **Issue 3: Containers not starting or stuck initialising** - **The fix:** Check logs in OrbStack or terminal with docker compose logs. Verify ports in .env don’t conflict with other services. ## **Final thoughts** Installing CKAN using Docker on a Mac has never been simpler or more efficient, thanks to OrbStack. This lightweight Docker management tool significantly reduces resource consumption while providing an intuitive interface. Whether you’re running a new Apple Silicon Mac or an Intel-based machine, this method ensures a consistent setup of CKAN for data management and analysis. CKAN’s open-source nature means you can deploy powerful data repositories without cost, and with Docker and OrbStack, you gain flexibility and control over your development environment. Try this approach and enjoy a fast, hassle-free Docker experience on macOS. --- Does your team need experts to update your CKAN portal? [Message Link Digital.](https://linkdigital.com.au/get-in-touch/) Read more tutorials from Brett Jones [here](https://linkdigital.com.au/news/author/brettjones/). **Categories:** All articles, CKAN, Open Data, Resources, Tutorial **Tags:** CKAN, CKAN Docker installation, open data, OrbStack --- ### [CKAN Insider #3: Why contributing back to CKAN makes good business sense](https://linkdigital.com.au/news/2026/05/ckan-insider-3-why-contributing-back-to-ckan-makes-good-business-sense/) **Published:** May 19, 2026 **Author:** Andrew Nette **Content:** ![Image of CKAN Insider with Andrew Nette and Ian Ward - Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/05/img-cover-CKAN-Insider-blog-Ian-updated-1024x576.webp) For over a decade, Link Digital has been using the [Comprehensive ](https://ckan.org/)[Knowledge](https://ckan.org/)[Archive Network](https://ckan.org/) (CKAN) to build data infrastructure globally. Since 2019, we have been a co-steward of the CKAN software. But what exactly does it mean to be a co-steward? And when organisations evaluate a vendor like [Link Digital ](https://linkdigital.com.au/)as a potential partner in their data operations, does it matter whether the vendor contributes back to CKAN’s core software? One person who can answer these and other questions is [Link Digital’s Senior Solutions Architect, Ian Ward](https://www.linkedin.com/in/ianward/). Ian is also part of the CKAN Tech Team, which is responsible for the technical vision and the core software. As the CKAN community gears up to celebrate the software’s 20th anniversary, I spoke to Ian about what co-stewardship means, the day-to-day work that takes place to maintain CKAN’s core functions, and why contributing back to the software is not just good for the CKAN community but good business sense. ## **Learning to appreciate open source** While Ian has been involved with CKAN for the last decade, he started to appreciate the advantages of open source over 25 years ago. For him, open source technology gives users control over what’s running on their computer. “You don’t always have to get permission for everything or pay for everything necessarily and you can actually have freedom to build what you want.” Ian’s involvement in open source software took a major leap when the opportunity came up to work on the federal Canadian government’s national data portal, [Open Canada](https://opencanada.org/), which was built using CKAN and launched in early 2011. “To work on an open data platform that was also built on open-source technology… was exciting due to the ability to collaborate with other governments and technology professionals doing the same work.” ## **Working ‘under-the-hood’ of CKAN** Much of Ian’s CKAN work focuses on the ‘under-the-hood’ architecture and developer experience of CKAN. “I’m very interested in how all this stuff works and making improvements that I find interesting. The cool and exciting things that people are doing with CKAN often are about integrating \[it\] into big existing systems that are publishing datasets or consuming datasets, that are creating visualisations, that are tying it into larger processes or workflows.” This often means that in addition to working on exciting integrations related to visualisations and large system workflows, Ian focuses on making smaller changes to the core CKAN software to prevent limitations that could hinder developers and to maximise the software experience for all users. “Some of the stuff that I do might seem very boring or not super flashy. But it’s all about trying to enable people that are doing those more exciting things so that they can use CKAN to do that.” ## **CKAN co-stewardship in practice** What exactly does it mean to be a CKAN co-steward? “For me… I’m helping review pull requests. I’m helping to submit changes that I think would be better for CKAN in the future to unblock functionality that maybe hasn’t been as easy to do in the past. I’ll be providing feedback as part of reviewing those pull requests and regularly attending the developer meetings and trying to make a space that’s inviting for new developers to come and join and to have a place where people can have a conversation about some of the changes that are being made and influence decisions as we’re making them.” Co-stewardship also means contributing a lot of important fixes to the CKAN core to improve the software’s performance. These fixes often originate from work being done for [Link Digital clients.](https://linkdigital.com.au/case-studies/) One example is the performance enhancements Ian assisted with for handling very large data store tables, [which you can read about in more detail on our site here.](https://linkdigital.com.au/news/2025/11/ckan-2-12-faster-search-large-dataset-downloads/) “Some of the limitations that we’ve run into for Link’s clients are in terms of the performance when working with very, very large DataStore tables. And this is something that we’ve been working on to make it possible to have millions and millions of records in the datastore and still have queries running quickly \[and\] still have the data being possible to update quickly.” ![CKAN co stewardship activities by Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/05/img-co-stewardship-activities-1024x576.png) ## **The in-built flexibility of CKAN** Ian believes that one of CKAN’s major strengths is its in-built flexibility. “It’s very good at integrating with other data systems. And really everything that any business, any government is doing is powered more and more by data. So, having a sensible way to track that data, view changes on it, store things that you need like provenance information or licensing information or specific metadata fields that are customised for your organisation, all that stuff is key.” And while open data portals are what brought CKAN to the fore of data management, its wider applicability is huge. This includes tools for internal data organisation. “The fact is that you can customise every bit of the workflow, the way everything is connected, you can integrate it with any existing system very easily. The documentation is very good, especially for an open-source project. So, when you’re getting new people coming on or trying to build extensions to it, the learning curve is smooth.” ![CKAN, beyond data portals. how it tracks data](https://linkdigital.com.au/wp-content/uploads/2026/05/img-CKAN-beyond-data-portals-1024x576.png) ## **Contributing back to CKAN’s core** But when an organisation evaluates a vendor as a CKAN partner, is it important whether that potential partner contributes back to CKAN’s core? In this respect, while the argument against secrecy and unnecessary competition in terms of software development has been largely accepted in the government space, Ian believes it also makes good sense in other areas, including the private sector. By sharing the solutions created with open source tools, he argues, “we all become better at our jobs. It doesn’t become a disadvantage.” “By working on this stuff together, we’re able to have a lot more potential ideas, potential eyes on problems. Things can be solved in ways that you might not expect. If we want to do something one way but someone else has got a better idea or they’ve got something that works differently, then there is that competition and it’s done in the open and everybody can benefit from that.” And, in this regard, Ian believes selecting partners that contribute back to the CKAN core not only demonstrates their understanding of the community’s value and fosters collaboration on shared problems. It ensures that functionality is maintained and allows all parties to benefit from reusable and improved code. “Things that are built don’t quietly disappear when a customer goes away. They’re maintained in the community. Anybody can pick them up and run with them. And better yet, where there’s opportunity to create reusable functionality, there’s a real benefit to doing that and sharing that work so that the next time we need to build something similar or anybody else needs to build something similar, they can reuse that, potentially improve it.” ## **Helping guide the transition to CKAN 3.0** Ian is heavily involved in helping to guide the transition of CKAN toward its 3.0 release. Why is this release important and what will it offer? “3.0 will give us a chance to say, ‘Okay, we’ve looked at the way that we’ve been doing it for 20 years and now we would like to reorganise things, to simplify them, to make it a little bit easier to customise, to make it a little bit more modern.’ And at the same time, we can look at breaking some of the internal assumptions that were made about the way certain data structures are organised because the earlier decisions made sense at the time, but they might be holding us back in terms of flexibility or performance or for some other reasons.” “The opportunity to step away from some of the things in the past, I think, is a very exciting time for the project. And while it does potentially mean a little bit more work for people to make that upgrade, it’s going to clear the way for us to implement some of the exciting features that people are hoping for in the future.” [*Also read: CKAN roadmap – stability, speed, and 3.0*](https://linkdigital.com.au/news/2026/02/ckan-roadmap-stability-speed-and-3-0/) ## **Future challenges for CKAN** “CKAN, like any open-source project, definitely faces the challenge of how we keep the community going and continuing to grow. I would love to see more events or more structure being built up around the project to try to continue to grow the community.” Another challenge is the rapid rise of AI. “I think that we’re definitely seeing more people wanting the types of tools that they see coming out of major vendors. They want to be able to interact with their data catalogues more like they’re interacting with ChatGPT.” “When we’re building tools that are based on data, I believe it’s not the best idea to feed the raw data into a LLM (large language model) and ask it to do stuff with the data. So, the biggest opportunities are around having those tools provide code or connect other existing tools that are deterministic that then work with the data. And CKAN, by providing access to the data for those tools, makes it possible to have agents that are doing things in an intelligent way which is usually not having the LLM do the work, but having a custom tool do the specific work that’s required, whether that’s generating queries on data or connecting different systems to solve a particular problem.” “I see CKAN as something that empowers systems that are going to be built on AI tools and all of this stuff needs data to function and the best way to know which data that you need to use is by having good metadata and that’s exactly what CKAN’s about.” [You can watch the full interview with Ian on our YouTube channel here.](https://youtu.be/3VJUhKdwoBk) **Categories:** CKAN, Open Data **Tags:** CKAN, CKAN co-steward, CKAN community, CKAN extension, open data, Open source technology --- ### [CKAN Insider #1: Key lessons from client conversations](https://linkdigital.com.au/news/2026/04/ckan-insider-1-key-lessons-from-client-conversations/) **Published:** April 15, 2026 **Author:** Andrew Nette **Excerpt:** Key insights from Link Digital’s CKAN Insider: how to evaluate open-source data portals, avoid migration pitfalls, and ensure long-term project success by treating your launch as day one. **Content:** Success with CKAN requires viewing the platform as an evolving framework rather than a one-time product launch. - [Major challenges and concerns](#aioseo-major-challenges-and-concerns-5) - [Preparation is key](#aioseo-preparation-is-key-23) - [Overestimating and underestimating needs](#aioseo-overestimating-and-underestimating-needs-27) - [The metadata mirror](#aioseo-the-metadata-mirror-32) - [CKAN projects that succeed and those that struggle](#aioseo-ckan-projects-that-succeed-and-those-that-struggle-41) - [An evolution, not a big bang](#aioseo-an-evolution-not-a-big-bang-47) Link Digital’s Chief Revenue Officer, [Scott Lingard](https://www.linkedin.com/in/scottlingard/), talks to clients and prospects about the [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN) every working day. Each of them is at a different stage of their data journey and has their own challenges when it comes to data infrastructure. This gives Scott an excellent insight into their key concerns and common misconceptions about [CKAN](https://linkdigital.com.au/ckan/). It also means he has an excellent understanding of the preparation that needs to be undertaken before jumping into the implementation of new data infrastructure and the differences between successful CKAN projects and those that struggle. In the first of a new series to mark the 20th anniversary of CKAN, CKAN Insider – Link Digital’s Chief Marketing Officer [Kate Sampher](https://www.linkedin.com/in/katrinasampher/) spoke to Scott about these issues. ## **Major challenges and concerns** Scott made clear from the outset there’s no such thing as “a typical client”. They’re a broad spectrum of organisations, from large not for profits, to niche research organisations and national level government bodies, working with us to implement, maintain and grow their [CKAN](https://linkdigital.com.au/ckan/) instances One thing most of them have in common is that “they’re at a data crossroads. They’ve outgrown a basic file sharing system or legacy portal that’s become basically a graveyard for all their data and all their information, and they realise they need a full professional ecosystem not just a website.” Often, they are struggling with new mandates that necessitate them having to be more transparent, or \[they\] are facing challenges like the growing complexity of their metadata or an increase in the volume of their users. And these things have shown up the technical or other failures of their current data infrastructure. ![A comparison of website vs data a portal](https://linkdigital.com.au/wp-content/uploads/2026/04/web-vs-data-portal-1-scaled-1024x722.png)A comparison of website vs data a portal “That’s when we really see them come to us, and the types of organisations are varied, but they’re always at that breaking point, and they always need something, and they need it to sort of manage things as they move.” The top questions that organisations have when they first start evaluating a potential data infrastructure project using open source software such as CKAN are around sustainability and control. “They’re tired of having been locked in with a big global corporate vendor, and they want to know, if they build on CKAN, do they own it? Can they move it? And who supports it \[the new infrastructure\] if the original dev team, all of a sudden, leaves?” Scott’s response to these concerns is to emphasise the benefits of the open source nature of CKAN. The software not only eliminates vendor lock-in by giving users the freedom to modify, upgrade, tailor or combine software solutions, it also guarantees data sovereignty, meaning they will own the code, their data, and their platform. ![A comparison of working with proprietary vendors vs open source](https://linkdigital.com.au/wp-content/uploads/2026/04/img-proprietary-vs-ckan-open-source-scaled-1024x722.png)A comparison of working with proprietary vendors vs open source This links to another common misconception about CKAN: “The belief it is a plug-and-play application like Microsoft Word that can solve all problems. CKAN is a framework, like a commercial kitchen providing the industrial stove and prep tables, but the organisation must still decide on the menu and hire the chefs. CKAN is intentionally minimalist to allow for customisation, not because it is missing features.” CKAN, like many open source software products, is designed to be modular, allowing users to swap one component for another without having to rebuild their entire data infrastructure. ***Also read:*** [*Planning your data infrastructure? The* ](https://linkdigital.com.au/news/2026/03/benefits-of-open-source-compared-to-proprietary-software/)*[benefits](https://linkdigital.com.au/news/2026/03/benefits-of-open-source-compared-to-proprietary-software/)*[*of open source compared to proprietary software.*](https://linkdigital.com.au/news/2026/03/benefits-of-open-source-compared-to-proprietary-software/) ## **Preparation is key** While an organisation cannot figure everything out in advance of starting a major data project, preparation in some key areas is crucial. Foremost of these, according to Scott, is that they’ve got to understand what their metadata and metadata schema is. “They need to know what is on their shelves before they start building the shelves.” The consequences if they skip this process is that “they end up with a messy portal that no one can search effectively. And you’re just moving the mess from one room of the house to another effectively, without being able to know what’s on those shelves.” ## **Overestimating and underestimating needs** Another issue that Scott notices with a lot of organisations putting into place new data infrastructure, is that they overestimate what they will need in terms of customised code. The wide array of existing CKAN extensions can usually handle 90% of their requirements and “they don’t need to do a lot of custom work”. Conversely, they often underestimate the importance of [user experience](https://linkdigital.com.au/news/2026/03/making-data-portals-user-friendly-a-conversation-with-a-ui-ux-expert/) and governance. This can result in too much data that is not organised well, particularly the metadata. A data portal is useless, notes Scott, if a non-technical researcher cannot find a data set in three clicks. In this respect, “product failure is less about technology and more about the lack of an internal workflow for approving and updating data.” Matching the correct tech solution to the client’s needs requires honest conversations. “If they just need to host five PDF reports a year, they don’t need CKAN, they can use content management software. If you need a private collaborative sandbox for messy drafts, you need a document management system, not a data portal.” ***Also read:***[ *Frequently asked questions about end-to-end CKAN services.*](https://linkdigital.com.au/services/end-to-end-ckan/) ## **The metadata mirror** “I think some of the biggest challenges you see during that transition is what I refer to as the metadata mirror. Migrating data \[infrastructure\] acts as a giant spotlight sometimes on years of bad data entry. And you’re not just moving those files… you’re mapping messy legacy metadata into a clean new standard.” This presents real challenges, and can make the process much longer because once a client is in the midst of the data transfer, they have to work with the developers to go back and fix up all the past errors. Scott also has advice for any organisation considering or in the middle of planning a change in their data infrastructure to CKAN. “If there’s something that’s not going to add any value into your portal and make it more complex, don’t migrate it across. Just leave it where it is. And then there’s also the sort of the 80/20 rule, where you identify the 20% of your data that is going to get 80% of the traffic and you move that first, get that perfect, and then you decide if the rest even needs to be migrated or just archived.” ![A diagram of data federation with CKAN](https://linkdigital.com.au/wp-content/uploads/2026/04/img-data-federation-scaled-1024x736.png)A diagram of data federation with CKAN *Case study:* [*How Link Digital developed a CKAN-powered open data catalogue for the Inter-American Development Bank.*](https://linkdigital.com.au/case-studies/inter-american-development-bank-open-data-catalogue/) ## **CKAN projects that succeed and those that struggle** What are the early warning signs in a project that predict trouble down the line? “The projects that struggle are the ones that treat the launch of the portal as the finish line. But the projects that succeed treat that launch of the portal as day one. They know it’s an ongoing thing… and they can add more.” “The beauty of using something like CKAN is you can keep evolving it. You can keep making it better. It’s not a set and forget. And that’s where I sort of see that project versus product. So, it’s not the finished product on day one that’s the end result. That’s the start and you can start iterating and developing further and further from there.” Another warning sign, according to Scott, is if a CKAN data portal is owned solely by the tech people or the IT department of the organisation implementing it. The entire organisation – not just its technical people – needs to be in lockstep with the project. “It \[also\] needs to be owned by the business and even the policy side of the organisation. So, they know what’s moving across and how the data is collected, how the data is going to be shown, what data is going to be in there, and how it’s going to drive engagement with what is in that portal.” ## An evolution, not a big bang Scott has one piece of advice for those at the very beginning of their seeking journey: “Don’t let the perfect be the enemy of the good.” Start with a solid core CKAN implementation, “get your best data in there and let user feedback guide your growth. It’s really an evolution. It’s not a big bang.” [You can watch the full interview with Scott on our YouTube channel here.](https://www.youtube.com/watch?v=HAawsaHawZI) ***Want to discuss your data needs?*** [*Reach out to* ](https://linkdigital.com.au/get-in-touch/)[*Link Digital’s sales team here for a no pressure conversation.*](https://linkdigital.com.au/get-in-touch/) **Categories:** CKAN, Digital Public Infrastructure, Environmental/Climate Change, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data **Tags:** CKAN, CKAN project preparation, user experience, vendor lock-in --- ### [CKAN Insider #2: What Link Digital has learned as a CKAN co-steward](https://linkdigital.com.au/news/2026/05/ckan-insider-what-link-digital-has-learned-as-a-ckan-co-steward/) **Published:** May 4, 2026 **Author:** Andrew Nette **Excerpt:** It's not connected to some technological track like AI. It's not dependent on those things. It's only dependent on the three things that ground it, which are contributors, platform users, and the value it creates. **Content:** The founder and Executive Director of Link Digital, [Steven De Costa](https://www.linkedin.com/in/stevendecosta?originalSubdomain=au) has been involved in the community around the open source data management software known as the [Comprehensive Knowledge Archive Network](https://ckan.org/) since 2012. For the last five of those years, Link Digital has been a CKAN ‘co-steward’, supporting the community of users and contributors that collaborate with the software project. The growing role of [CKAN](https://linkdigital.com.au/ckan/) in the digital ecosystem is evidenced by the fact that it serves as the key component of some of the largest and most successful open data portals around the world. But what of its future? In the second in a series of interviews to mark CKAN’s 20th anniversary, Link Digital’s Marketing Officer [Kate Sampher](https://www.linkedin.com/in/katrinasampher/) spoke to Steven about his involvement with the software and its future directions. ## **Link Digital’s early engagement** CKAN was crucial to what Steven describes as “a real blossoming of the open data community” from 2009-2012, around the time that Link Digital first got involved in CKAN and began to use the open source software as a vital component in its global work building data management solutions for clients. Established in 2001, Link Digital’s engagement with CKAN was driven at first by Australian national and state governments that were keen to develop data portals of their own. The first of these, [data.gov.au](https://data.gov.au/) – Australia’s national data portal – established in 2013, was a particular important development. “It created this opportunity for CKAN to be adopted by the Australian national government and their open data program. So just catching that and being involved in that, made me feel confident that progressing CKAN would make a lot of sense.” ## **CKAN: more than just software** The central reason that Steven has never wavered in his belief in CKAN is his understanding of the reciprocal nature of contributing to the project. “For us as a service supplier, every time we invested in CKAN as a technical solution, we got real value in return. Every time we put effort into the project, we got a response back.” This is, in turn, connected to CKAN’s guiding principle: that open data is a public good that should be non-right restricted and easily transferable, and that creates more value the more it is shared. It also links to Steven’s view that CKAN is more than just a software project. It is “a group of people, and a community of customers that is highly aligned with reciprocity and deserves continued investment from people who can benefit from it.” ## **Rethinking open data?** Which is not to say that CKAN, and the open data movement more generally, does not face challenges. One of these is the rise of AI, which is pushing a rethink on the part of governments and other large organisations about what data they share, the terms under which they might share it, and what data sovereignty might mean in this new era. Is this redefining open data and, if so, what could it mean for CKAN and the companies like Link Digital that use it? Steven agrees that while it’s a big question, he does not think the nature of open data is changing. “I think it’s still a thing that revolves around and upon accountability, transparency and good governance… So, open data and openness generally are part of that.” “Certainly, AI is a different kind of beast. It’s kind of this idea that reality once observed, can be modelled and internalised. And once you can observe reality as modelled and internalised, you can create a knowledge operation. You can create a model that would reciprocate what it’s internalised. That kind of technological shift does not change at all the dimension of value for open data. It just changes the engine or the mechanism upon which open data is valued.” ***Also read:**[ What is the future of open data in the AI era?](https://linkdigital.com.au/news/2026/03/what-is-the-future-of-open-data-in-the-ai-era/)* ## **The Objective Observer Initiative and CKAN’s future** One of the ramifications for open data from the rise of generative AI and large language models, is that while making data open is still crucial, it is now no longer enough. In addition to sharing data, what is needed is verifiable honesty. This is a core purpose behind the [Objective Observer Initiative](https://linkdigital.com.au/news/2026/02/the-objective-observer-initiative-and-the-challenge-of-being-fully-open/) (OOI), a framework that Steven has been working on for the last 12 months, which attempts to blend philosophy, mathematics and physics, open data, AI and digital platforms into a new digital ecosystem framework that is more transparent, objective, and accountable. “The whole idea of the OOI is just to recognise the fact that independent of what technology is out there and independent about how attractive it is and how much we want to use it, AI is still based on data, and data is based on perception.” The OOI focuses on how we can leverage technology like AI to create “better data” that can be objectively trusted between parties, aiming for a perceptual model over a cognitive model in AI. The goal is to create data where the agreement upon objective understanding is somewhat independent of the parties involved. As Steven sees it, the nature of CKAN means that, while it may not be the sole technical solution, it is a good entry point to potentially start using the OOI to generate better data. ***Also available to read:** [The Objective Observer Initiative and the challenge of being fully open.](https://linkdigital.com.au/news/2026/02/the-objective-observer-initiative-and-the-challenge-of-being-fully-open/)* ## **CKAN: relevant for another 20 years** Steven has no doubt that CKAN will still be around in 20 years’ time. Central to the project’s longevity is its grounding in three key areas: a community of contributors, platform owners – the software’s implementers and users – and the value the platform creates for end-users. “I think this kind of triangulation between CKAN’s contributors, platform owners and end users, is what grounds it as a project.” “It’s not connected to some technological track like AI. It’s not dependent on those things. It’s only dependent on the three things that ground it, which are contributors, platform users, and the value it creates.” “I’ve given to CKAN, and it’s never failed to give back. As a software project, as a group of people, as a group of customers that want to use it, it’s never failed to give back. Every time I give in to it, it creates value. So, after 20 years, I just think this project is something that is amazing. It deserves more people to invest into and deserves more people who benefit from that.” [*You can read CKAN Insider# 1: Key lessons from client conversations on our site here.*](https://linkdigital.com.au/news/2026/04/ckan-insider-1-key-lessons-from-client-conversations/) **Categories:** All articles, Artificial Intelligence, CKAN, Objective Observe Initiative, Open Data **Tags:** CKAN, CKAN co-steward, open data, Steven De Costa --- ### [CKAN for Geographic Information Systems capable data portals: why it’s the smart choice](https://linkdigital.com.au/news/2025/02/ckan-for-geographic-information-systems-capable-data-portals-why-its-the-smart-choice/) **Published:** February 11, 2025 **Author:** Andrew Nette **Content:** ## **GIS and CKAN** A Geographic Information Systems (GIS) capable portal is an online data repository that enables users to store, search for, access, download and share quality geospatial data sets, as well as other data. CKAN – [the Comprehensive Knowledge Archive Network](https://ckan.org/ "the Comprehensive Knowledge Archive Network") – is robust open source software with a global reputation for building data portals, including those that host geospatial data. CKAN’s abilities come into play almost as soon as it is deployed and hosted on a web server. But it’s functionality in relation to GIS data can be greatly increased by a variety of extensions that integrate in a seamless manner with a user’s existing data and digital set up and allow for sophisticated GIS data visualisation and mapping. Let’s look in more detail at what a CKAN powered GIS capable data portal can do and the value it can add to your data operations. This includes some of the CKAN extensions specifically designed to work with geospatial data. We will also examine some examples of Link Digital’s work for clients in this space. ## **Table of contents** - [What can a GIS-capable data portal do?](#aioseo-what-can-a-gis-capable-data-portal-do) - [Why CKAN is the ideal foundation for GIS-capable data portals](#aioseo-why-ckan-is-the-ideal-foundation-for-gis-capable-data-portals) - [CKAN and GIS components](#aioseo-ckan-and-gis-components) - [Turbo charging GIS data sharing with CKAN extensions](#aioseo-turbo-charging-gis-data-sharing-with-ckan-extensions) - [Use cases on GIS-capable data portals by Link Digital](#aioseo-use-cases-on-gis-capable-data-portals-by-link-digital) - [The Pacific Data Hub](#aioseo-the-pacific-data-hub-overseen-by-the-pacific-community-the-pacific-data-hub-is-the-most-comprehensive-data-collection-of-relevance-to-the-22-pacific-island-nations-and-territories-and-allows-data-to-be-searched-by-country-or-subject-and-presented-in-different-visual-ways-including-geospatially-for-example-the-site-contains-an-interactive-map-of-the-pacific-region-that-finds-geospatial-data-on-the-hub-and-shows-it-in-map-form-users-can-explore-it-to-find-related-datasets-as-well-as-add-data-to-it-in-relation-to-population-data-essential-for-everything-from-disaster-risk-assessment-and-response-to-infection-disease-control-to-coastal-fisheries-management-the-hubs-features-include-population-maps-that-take-actual-or-projected-population-data-and-represent-the-spatial-distribution-on-a-continuous-grid-surface-the-hubs-food-trade-database-delivers-interactive-trade-data-on-food-and-beverage-commodities-across-the-pacific-which-can-also-be-viewed-geospatially-27) - [Canadian Watershed Information Network (CanWin)](#aioseo-canadian-watershed-information-network-canwin-30) - [Columbia Basin Water Hub](#aioseo-columbia-basin-water-hub-32) - [Conclusion](#aioseo-conclusion) ## **What can a GIS-capable data portal do?** Geospatial data is any data that has a geographical location component. This encompasses a wide variety of data types: maps, satellite imagery and remote sensing data, and what are known as ‘vector data sets’, visual data representations that describe the shape and location of features such as natural landmarks, buildings, and administrative boundaries – anything from maritime fishing zones to local government areas and different levels of voting electorates. A GIS capable portal is an online web application designed to make these data sets easier to catalogue, search for, access, download, understand and share. They can be public facing or for internal use or combine both interfaces. Some data portals are designed for GIS data only. One example is [Digital Twin Victoria](https://digitaltwin.vic.gov.au/public/ "Digital Twin Victoria"), a platform that gathers a large amount of 2D, 3D and live data about the Australian state of Victoria’s built and natural environment and makes it available for analysis and sharing. But far more common are data portals that are GIS capable, that is they host geospatial data along with other data types. This is because, while geospatial data is valuable, other datasets are usually needed to make sense of it, perhaps a report that includes an explanation of what the GIS data is, the collection methods and how it might be used, or tabula data that cannot be visualised on a map. GIS capable data portals are an essential tool for researchers, government agencies, businesses, and not for profits that use geospatial data in their day-to-day operations. They make geospatial data storage, discovery and sharing easier and more efficient. And they can enable collaboration and foster more informed decision-making across fields as diverse as urban planning, environmental management, demographic analysis, overseas development, and natural disaster response, to name a few. ## **Why CKAN is the ideal foundation for GIS-capable data portals** Creating one centralised data management platform using CKAN can have a transformative impact on an organisation, not only by enabling easier and more efficient and accountable data sharing, but by reducing risk of error due being able to register, update and refine datasets for a single point of truth. CKAN data portals encourage cross-organisation and cross-jurisdiction data sharing in a secure manner. Its custom designed application programming interface integration makes it easy to import data from other services at regular intervals, including legacy data systems. Enhanced security controls include the ability to limit access to selected datasets by setting group and individual permissions. They also allow for version control and audit trails, so any changes can be tracked, enabling data accountability and traceability. ## **CKAN and GIS components** As part of empowering applications and those who use them to produce trustworthy analysis and fine data and information, CKAN is a natural fit for data portals that include a geospatial data component including: ● Advanced metadata and cataloguing to organise and structure internal data. ● Advanced search functionality, allowing users to search for geospatial datasets by keywords and tags, or by theme, region and topic. ● Application programming support for developers to build GIS applications or integrate with a wide range of GIS related software tools. ● Support for common GIS download formats: Shapefiles (a vector data file format used for geospatial analysis), GeoJSON, and Keyhole Markup Language (an XML software language mainly used on geographic visualisation, such as annotating maps and images). ● Interactive visualisations to improve data accessibility for technical and non-technical audiences. CKAN can also enable individual geospatial visualisations to be embedded on external websites. ![](https://linkdigital.com.au/wp-content/uploads/2025/02/Columbia-Water-Basin-Hub-1024x668.png)*Interactive map of the Columbia Basin in the Columbia Basin Water Hub mentioned below* ## **Turbo charging GIS data sharing with CKAN extensions** CKAN’s basic functionality in relation to GIS data can be vastly increased through a large range of extensions. These include: ***[ckanext-spatial](https://github.com/ckan/ckanext-spatial "ckanext-spatial")*** Specifically used to operationalise searching for geospatial data by helping CKAN understand a location associated with a dataset, for example a pair of map coordinates. These are then indexed allowing users to perform spatial searches for datasets that fall within an area of interest. *Ckanext-spatial* also includes harvesters for importing common geospatial metadata, such as [ISO 19115](https://www.iso.org/standard/53798.html "ISO 19115"), [ISO 19139](https://www.iso.org/standard/67253.html "ISO 19139") and [Catalog Service for the Web](https://docs.geonetwork-opensource.org/4.2/ "Catalog Service for the Web"). ***[ckanext-geoview](https://github.com/ckan/ckanext-geoview "ckanext-geoview")*** Contains plugins to enable users to access previews of geospatial files in CKAN. Along with *ckanext-spatial*, this is the most used extension in Link Digital’s GIS related toolbox. ***[ckanext-mapviews](https://github.com/ckan/ckanext-mapviews "ckanext-mapviews")*** Enables the creation of regular and choropleth maps to enhance data comprehension within CKAN. Choropleth maps are a type of thematic map where geographic areas are shaded or coloured in proportion to the value of a specific variable, for example, flood risk or election outcomes. ***[ckanext-harvest](https://extensions.ckan.org/extension/harvest/#: "ckanext-harvest")*** Provides a common harvesting framework for CKAN extensions. This allows for the automatic collection of metadata from other data catalogues and sources and offers CLI and WUI for managing harvesting tasks involving geospatial data. In the area of data quality and workflow [***ckanext-validation***](https://github.com/ckan/ckanext-validation "ckanext-validation") enables data validation and reporting capabilities for tabular data in CKAN portals, some of which is geospatial. While ***[ckanext-datarequests ](https://github.com/conwetlab/ckanext-datarequests "ckanext-datarequests ")***allows users to ask for datasets that are not already published within CKAN, including geospatial data. I ## **Use cases on GIS-capable data portals by Link Digital** Link Digital is one of the few global companies that can provide end-to-end service surrounding data publishing on CKAN. This includes building world-class GIS-capable data portals. ### ***[The Pacific Data Hub](https://pacificdata.org/ "The Pacific Data Hub")*** Overseen by the [Pacific Community](https://www.spc.int/ "Pacific Community"), the Pacific Data Hub is the most comprehensive data collection of relevance to the 22 Pacific Island nations and territories, and allows data to be searched by country or subject and presented in different visual ways, including geospatially. [For example, the site contains an interactive map of the Pacific region that finds geospatial data on the Hub and shows it in map form.](https://map.pacificdata.org/ "For example, the Hub contains an interactive map of the Pacific region that finds geospatial data on the Hub and shows it in map form.") Users can explore it to find related datasets, as well as add data to it. In relation to population data, essential for everything from disaster risk assessment and response to infection disease control to coastal fisheries management, the Hub’s features include [population maps that take actual or projected population data and represent the spatial distribution on a continuous grid surface](https://pacificdata.org/story/pacific-population-grids "population maps that take actual or projected population data and represent the spatial distribution on a continuous grid surface"). The Hub’s [Food Trade Database](https://stats.pacificdata.org/vis "Food Trade Database") delivers interactive trade data on food and beverage commodities across the Pacific, which can also be viewed geospatially. ![](https://linkdigital.com.au/wp-content/uploads/2025/02/Pacific-Data-Map-1024x618.png)*The interactive map of the region in the Pacific Data Hub* ### ***[Canadian Watershed Information Network (CanWin)](https://canwin-datahub.ad.umanitoba.ca/ "Canadian Watershed Information Network (CanWin)")*** Managed by [University of Manitoba’s Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/ "University of Manitoba's Centre for Earth Observation Science"), CanWin is an internal data management platform to collect and manage climate data, including geospatial data, and analyse and share it with researchers. Link Digital overhauled the existing CKAN-based platform to facilitate greater data storage capability, improved search efficiency, and new data visualisation tools, including the use of geospatial data, to enable researchers to tell more complex stories about their work. ### ***[Columbia Basin Water Hub](https://data.cbwaterhub.ca/ "Columbia Basin Water Hub")*** The Columbia Water Basin Hub is an open data portal developed by Link Digital and [Living Lakes Canada](https://livinglakescanada.ca/ "Living Lakes Canada"), a non-government water stewardship organisation with over 20 years of experience protecting freshwater in Canada’s Columbia Basin region. The Hub collects, catalogues and makes accessible new and historical data, including geospatial and spatial data, for decision-makers, researchers, students, professionals, and the public. [A good example of the Hub’s functionality is this sophisticated map feature that enables users to search for datasets geographically, as well as individually and by group](https://data.cbwaterhub.ca/map_cluster "A good example is this sophisticated map feature that enables users to search for datasets geographically, as well as individually and by group"). ## **Conclusion** Link Digital’s global team of CKAN experts can create a customised GIS-enabled data portal to align with your organisation’s unique needs. This includes helping to maximise CKAN’s functionality and versatility in geospatial data by utilising its wide array of extensions. Whether your aim is to create an online data repository to more efficiently catalogue and share geospatial internally, externally, or both, a Link Digital CKAN-powered portal can facilitate greater data exploration and visualisation. This makes your geospatial data more discoverable and easier to interpret and use, promotes greater improved data-driven decision-making and maximises collaboration. Not only can a CKAN data portal be easily scaled up or extended to meet evolving data needs, being open source means organisations can avoid license fees and vendor lock-in. This makes it more accessible and cost-effective, especially for small to medium-sized organisations and businesses. It also means users maintain the rights to their data and metadata. ## Let’s chat Do you have a data project that involves geospatial data? If so, I’ll be happy to connect you with our experts. [Get in touch](https://linkdigital.com.au/get-in-touch/ "Get in touch"). **Categories:** All articles, CKAN, Government, Higher Education/Research, Internal data hub, Open Data **Tags:** CKAN, Geographic Information Systems, geospatial data, GIS --- ### [Link Digital’s Executive Director, Steven De Costa, is running for a seat on the board of the Drupal Association](https://linkdigital.com.au/news/2012/09/link-digitals-executive-director-steven-de-costa-is-running-for-a-seat-on-the-board-of-the-drupal-association/) **Published:** September 18, 2012 **Author:** Steven De Costa **Content:** ![](https://linkdigital.com.au/wp-content/uploads/2017/08/Drupal-Feature-Image-4.jpg)*Note: This article was originally published in 2012 and has been restored for historical archive purposes.* Yes, it’s true, and the election process for two seats on the Board of the Drupal Association is now underway. This week you can meet all of the candidates over IRC and can to follow the details posted on the [Drupal Association’s election update page](https://association.drupal.org/election2013-update). I’ll post details on when I’ll be online for that soon, and it might actually be 6am AEST tomorrow morning… \[Edit: Yep, it was 6am on the 19th of Sept\] You can read [details about my nomination](https://association.drupal.org/node/17033) to learn more about me and why I’m running to get on the board of the Drupal Association. It’s posted on the Drupal site and also copied below ![:)](http://www.linkdigital.com.au/news/wp-includes/images/smilies/icon_smile.gif) You can email me directly with any questions via steven.decosta \[at\] [links.com.au](http://links.com.au/) and I’ll attempt to respond to everyone I hear from over the next three weeks. Lastly, I’ll post info about the election process as things evolve. Voting actually opens on the 24th of September so you can expect me to be tweeting and sharing content vigorously on this topic next week. My apologies in advance! ## About Me: I’m an optimist and a futurist. My first computer was an Apple IIe and it came with a course to learn the Basic programming language. I think I was twelve at the time. After almost 30 years and a string of cool upgrades I now have a pretty good system. I’m married to an awesome lady and we have two incredible kids. We live a privileged life in the suburbs of Canberra, Australia and both work in the [digital infrastructure company](http://www.linkdigital.com.au/) I co-founded back in 2001. Building websites is something I began to do while studying for a Bachelor of Economics at the Australian National University. My first real job was as a tester in a multimedia company. As that company began to shift from CR-Roms to websites I began my journey as a professional developer. The last three years have been amazing. Technology appears to have overrun the lives of everyday people and social publishing appears to be driving unprecedented levels of collaboration and ‘open’ mindedness. Within this environment I went on secondment as the Chief Marketing Officer (CMO) for one of my company’s clients, working formally in an executive role for the first time. It was an amazing experience. I was able to use my knowledge and love of web technologies in a new way, to evangelise and inspire positive change through ideas and leadership alone. In March this year I came back into my web development company with a fresh and much more global perspective. I started to get more involved in the local open Government community, sponsored [GovHack.org](http://GovHack.org) and starting finding more and more people who were passionate about creating better public outcomes through collaboration, open source and new approaches to old problems. Drupal is a vehicle for change. I developed my own content management system (CMS) in 2003 and have evolved it over time to meet the aggregated needs of my clients. It’s a good CMS, but the pool of clients using it is relatively small, so the force behind it is tiny when compared with Drupal. While I’ve been exposed to Drupal since v5 it’s only since v7 that it’s had my full attention. Drupal is now the preferred CMS for my company and we’re using it gratuitously. I recognise that I’m a fresh face within the Drupal community and haven’t yet contributed a single line of code. However, I’ve just aligned my entire company with the project and am looking to remain in the game for a good while yet. I expect there are more than a few companies like mine, crossing over from bespoke platforms to join the ranks of developers pushing Drupal forward. I’ve found the Drupal community to be entirely welcoming of new people, so much so that I’ve been warmly encouraged to run for a Board position by everyone I’ve spoken to about it. ## Motivation: I want to be a voice for developers and those running small web agencies. By extension, I also want to represent the clients of developers and small web agencies – from individuals and small business all the way up to large enterprise and Government organisations. My motivations for seeking the Board position include: ***I think I’ll enjoy it, do a good job, listen carefully to the community and advance the Drupal Association’s objectives diligently.*** ***I want to promote deeper involvement between Government and their local Drupal communities.*** I would like to evangelise the present opportunity for Governments to invest in, and help to support, the ongoing development of Drupal. At the Board level I would align with others to ensure that the Association is capturing the opportunity to make the most of the current investments being made by Governments all over the world. I would seek to coordinate information and resources that assist in turning these significant investments into code contributions and, further, help to establish commitments for ongoing and predictable investment from Government. Here in Australia, the Federal and State Governments are already investing heavily in Drupal. I’m keen to mature at least the Federal Government to a position where it sees itself as a single entity making a large volume of significant investments into a platform in a coordinated way. With a little effort we can encourage many Government organisations to become contributors within the Drupal community and begin to take the reins on a number of projects where they can make much deeper investments into outcomes they will take great benefit from. ***It’s time for companies like mine to back a winner and I’m running with Drupal.*** The web development industry is changing, which is no surprise as it’s never stood still for long. For me, and maybe this is true for a lot of developers, life is like a box of lego. Unlike a box of chocolates, with lego you aren’t stuck with what you get as you have the freedom to innovate, transform and create almost anything you can imagine. Having a position on the Board of the Drupal Association will raise my personal profile within the Drupal community, generate brand equity for my company and generally open doors to commercial opportunities that might otherwise remain closed. While all of that is great, I’m mostly motivated here by my desire to have input into a project and a community which is now fundamentally linked to the future wealth and wellbeing of my family. ## Experience: I have been a [Director of various companies since 2001](http://www.linkedin.com/in/stevendecosta), most notably of Link Digital, where I’ve been the Chairman since 2002. I provide management across all areas of the company while also providing strategic, creative and technical direction for key accounts and projects. Currently, my primary responsibilities encompass business development and technical direction. From July 2010 to March 2011, as the CMO of UberGlobal, I developed and managed strategies for multichannel strategic marketing to drive organic customer growth and increased average revenue per user. My direct responsibilities encompassed brand development, web site traffic growth, web site UI, social strategy, product packaging, pricing and online sales conversion. After establishing a strategic marketing framework for UberGlobal’s position within the Australian cloud services industry (they are the third largest provider by market share) I sought to capture opportunities to strengthen Uber’s supply and distribution channels. Working with a key supplier, in early 2011 I raised significant investment funding for a Government Community Cloud platform and published an internationally referenced whitepaper on the subject of Community Cloud. This was launched at the Microsoft Worldwide Partner conference in July 2011. Working to expand distribution channels for UberGlobal I spearheaded contract negotiation, strategy and tactical execution of a wholesale distribution agreement between UberGlobal and Ingram Micro Australia. The resulting enterprise hosting services partnership was announced in November 2011. Somehow, that old Apple IIe put me on a path that led me to found a company, fall in love with technology, build a string of successful business relationships and ultimately land me in Munich for DrupalCon. I’m ready for whatever comes next. **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [What can a Canberran bring to the Board of the Drupal Association](https://linkdigital.com.au/what-can-a-canberran-bring-to-the-board-of-the-drupal-association/) **Published:** September 23, 2012 **Author:** Steven De Costa **Content:** ![](https://linkdigital.com.au/wp-content/uploads/2017/08/CAN-DRUPAL-Feature-Image-4.jpg)In 50 words or less (or, maybe 65)… **I’ll bring a strategic marketing framework to the Board – but don’t confuse this with posters and tweets. I want to help the DA define its position within a broader economic view of the IT services industry and leverage the flow of value to benefit the Drupal project. 1st up: I’ll aim to bring in new funds via Govt memberships and a grants funding initiative.** Now, the extended version… I aim to bring new members from the user side of the community, create targeted global special interest user groups that help the project continue to thrive, and I aim to bring new funding opportunities to help support all the Association’s existing initiatives. ## Where does Drupal sit in the economic value chain? If you look at the entire IT industry, it is mostly part of a supply engine. Actual production of economic output occurs either via the platforms implemented or is facilitated by them (such as with an eCommerce website). From what I’ve experienced so far, the Drupal community currently represents the aggregated needs of those working within this supply ecosystem. It has very little involvement with the actual outputs being produced by customers. ## What are the long term threats to the Drupal project? I see two significant threats to the Drupal project if it stands only within the economic footprint of IT services: 1. The contraction of the IT services chain is real, so the market for Drupal will shrink and ultimately be replaced with services that emerge directly within hosted service platforms and are click-configured directly by user organisations. 2. The Drupal services ecosystem will begin to cannibalise itself. Groups are already providing hosted distributions that can be deployed directly by clients without any additional partner support. Distribution contributors are pivoting toward monetisation strategies that will also aim to capture the direct customer dollar. In a more competitive atmosphere, where the business process IP of coded modules and distributions is seen as a possible revenue model, groups will begin to hedge their community efforts in favour of entirely commercial efforts. ## What is an immediate opportunity for the Drupal project? Drupal is being adopted by a lot of organisations worldwide that are choosing it over the online publishing platforms of proprietary software vendors. The opportunity exists for the Drupal project to engage with site owners and operators so it can better understand and aggregate their needs. The entire project could benefit significantly by stepping more into the world of end users, understand how to best add unique value to their production capability, then nurture and secure each vertical by investing resources to support that special interest group. ## Do the Association goals align with this opportunity? It’s important to note that the Drupal Association has **no authority over the planning, functionality and development of the Drupal software**. Even the Drupal.org sites, which are a responsibility of the Association and are in need of significant upgrades in content, structure, platform and functionality are currently managed and maintained by teams of dedicated volunteers from the Drupal community. Referring to the [statutes for the Drupal Association](https://association.drupal.org/about/history/drupal-vzw-statutes), the goals are described as: > The purposes of the Association shall be for providing support in developing, communicating, promoting, distributing the Drupal project and in deploying an infrastructure in support of the Drupal project. > > The scope of the “Drupal project” shall include the following specific issues: the Drupal open-source software system (http://drupal.org), the community of developers and users of this software and all associated activities and all infrastructures in their broadest sense considered to be required to further develop this project. What does the community of developers and **users of Drupal** look like? [This diagram helps](http://drupal.org/files/issues/drupal-community-diagram_1.jpg) illustrate the Drupal Community, which in turn helps to show what the scope of the Drupal project is. The biggest population in the diagram falls into the category of ‘People that use Drupal’. Who are these people? Depending on your perspective: 1. They are Drupal site owners and operators 2. They are the Drupal developers who setup the sites and might still maintain them from a technical perspective. 3. They are both of the groups above. No matter your perspective, the population of people that use Drupal is large enough to cover the specific interests of 7.2 million Drupal sites ([as estimated in July 2010](http://engineindustries.com/blog/jason/how-many-websites-use-drupal-lets-estimate-number-part-one)). So, the Association goals are to support users, the community is defined to be inclusive of users, yet I suspect there are a lot less that 7.2 million interested parties currently being targeted for support by the Association under its current set of initiatives. **Lets inform, interact and transact with those using Drupal to further develop the project for *everyone* *in the Drupal community*.** ## Where can new funding initiatives emerge? With my own bias of being located in Canberra, the Capital city of Australia, I see providing support to National Governments as the closest and most significant opportunity. Collectively, Government’s already have billion dollar budgets for IT expenditure and they are open to petitions from non-profits to rethink how they spend those dollars to provide better economic and social outcomes. Further, there are growing Open Government and Open Knowledge movements which the Association can align or partner with to help generate a voice that extends beyond the subject of software development and further into the realm of social publishing. I will work with others to directly bring together the needs of National Government organizations and encourage them to join the Association as individuals, organizations and supporting partners. I will encourage this group to seek ways it can work with Drupal developers and commercial organizations to further the Drupal project in alignment with their specific needs. This could initially be run as a grants program which funds specific development outcomes; such as best practice models for lifecycle management, enterprise architecture, security hardening and performance optimization. If it works, the funding model scales by the formation of additional special interest groups (SIGs) within industry verticals such as finance, retail, entertainment, etc. Ultimately, to be truly scalable, the mechanics to generate SIG project funding could be modeled on existing crowdsourcing approaches used on sites like Kickstarter.com and bidded for by commercial groups or individuals who are registered members of the association. Self-organizing SIGs can make their own rules on deciding on who receives the development grants on offer and Association revenue can be derived through a small percentage of the funds allocated against SIG projects. Importantly, all of this can be supported by the tasks the Association is entitled to undertake in support of its goals. All it needs is someone to kick things off with a business case to establish the initiative, and that is something I’m already working on. If you are in support of public money funding significant development initiatives within the Drupal project, please consider casting your vote in my direction ![:)](http://www.linkdigital.com.au/news/wp-includes/images/smilies/icon_smile.gif) Either way, I’d love to receive your comments below. **Who can vote in the elections?** You are eligible to vote if you have an account on drupal.org, logged in during the past 12 months, and created your account before 31 August 2012 when the election was announced. **How to vote?** - Login at [http://association.drupal.org](https://association.drupal.org/) - Go to - Check a box confirming you are eligible to vote. - Rank the candidates in your order of preference. You do not need to rank all candidates. - Save the form. **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [New Vehicle Emissions Star Rating: using public data to benefit the environment](https://linkdigital.com.au/news/2024/03/new-vehicle-emissions-star-rating-using-public-data-to-benefit-the-environment/) **Published:** March 20, 2024 **Author:** Andrew Nette **Excerpt:** Link Digital congratulates the New South Wales Government on the launch last week of its new website, Vehicle Emissions Star Rating (VESR), and we are thrilled to have played a role as its developer. **Content:** The VESR website is designed to assist consumers to factor in environmental impact when planning their next vehicle purchase, by allowing them to compare the carbon dioxide (CO2) emissions of new and used cars, Utes and vans. It does this by utilising a very straightforward six-star rating to compare CO2 emissions between vehicles, with the most stars indicating the most environmentally beneficial option. Data on CO2 emissions is based on a standard test that measures the amount of CO2 released per kilometre driven, as reported by all car manufacturers to the Australian Government’s [Green Vehicle Guide](https://www.greenvehicleguide.gov.au/). ## **Talking about** utilising Drupal [Link Digital](https://linkdigital.com.au/) harvested the data from the Green Vehicle Guide and built an interface between it and VESR, along with a vehicle identification and specification site known as [GLASS](https://www.glassguide.com.au/). We utilised [Drupal](https://www.drupal.org/), a free and open source content management system for building websites and web applications, to present all the data in a simple, easy to use, and visually appealing format. “The VESR website is a great example of a public program delivering public data in a manner that meets the needs of public interest,” said [Link Digital’s Chair and Executive Director, Steven De Costa](https://www.linkedin.com/in/stevendecosta/?originalSubdomain=au). “Working on such projects is extremely rewarding for [Link Digital’s](https://linkdigital.com.au/) team and we are sure the six-star system will be a great success.” “It’s been a privilege to be a part of the team working on the VESR website,” said Iaroslav Pereiaslovets, [Link Digital’s](https://linkdigital.com.au/) Chief Operations Officer. “I believe it will help deliver tangible results in the effort to help drive down light vehicle emissions.” As well as calculating CO2 emissions from vehicle tailpipes, the VESR website enables consumers to calculate the annual running cost of both petrol and electric vehicles, based on fuel price, model and annual travel distance. It also provides useful information for drivers of electric vehicles, such as locations of battery charging infrastructure and battery recycling. The VESR system is a great example of data being used to reduce carbon dioxide emissions and the intensity of climate change. Initiated and administered by the NSW [Department of Climate Change, Energy, Environment and Water](https://www.dcceew.gov.au/), the website has been endorsed by the Commonwealth and all Australian state and territory governments. [Link Digital](https://linkdigital.com.au/) is ready to start a dialogue with you and your team on your open data needs. Contact us and [tell us about your project](https://linkdigital.com.au/get-in-touch/). **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Government, Open Data **Tags:** CKAN, Drupal, open data --- ### [Empowering open data and beyond: major initiative to boost CKAN development](https://linkdigital.com.au/news/2024/05/link-digitals-major-initiative-to-boost-ckan-development/) **Published:** May 7, 2024 **Author:** Kate Sampher **Content:** ## **Table of contents** - [Investing in openness](#aioseo-investing-in-openness) - [With the community](#aioseo-with-the-community) - [Focus areas](#aioseo-focus-areas) - [DCAT v3 support](#aioseo-dcat-v3-support) - [Developer and maintainer experience](#aioseo-developer-and-maintainer-experience) - [Enhanced file management](#aioseo-enhanced-file-management) - [Looking ahead](#aioseo-looking-ahead) - [About the key contributors](#aioseo-about-the-key-contributors) In a significant move for the CKAN community of users and contributors, Link Digital has announced a new initiative that promises to enhance the capabilities and reach of CKAN, the leading open-source data management platform. Funded directly by [Steven De Costa](https://www.linkedin.com/in/stevendecosta), Link Digital’s Founder and Chairman. This initiative is a robust response to the growing demand for advanced data management and cataloguing solutions across government, non-profit sectors, and enterprises. ## **Investing in openness** Understanding the pivotal role that CKAN plays in open data specifically and data management more generally, Steven De Costa has committed to funding key roles targeting the improvement of the CKAN core and its primary extensions. This investment will support the dedicated efforts of notable CKAN developers Ian Ward and Adrià Mercader over the next 12 months. Additionally, Sergey Motornyuk, Tech Lead at Link Digital and a core contributor to CKAN, will also play a crucial role in this initiative. Their focus will be on refining CKAN to ensure it remains the top choice for open data portals and expands its utility for a variety of data management tasks. This strategic decision is not just about enhancing the software but is aimed at fortifying the infrastructure for both developers and end users and doubling down on [CKAN as a critical Digital Public Good](https://ckan.org/blog/ckan-is-now-a-digital-public-good). By improving the core functionalities and extensions, the initiative seeks to make CKAN more robust, adaptable, and user-friendly, catering to the diverse needs of its global user base. [Paul Walsh](https://www.linkedin.com/in/prwalsh/), CTO of Link Digital and open data veteran, will coordinate the initiative, aligning it with other ongoing CKAN projects, including the CKAN v3 roadmap. His role will ensure that the efforts of Ian, Adrià, and Sergey are synergistic with the broader goals of the CKAN community, particularly in terms of technical advancements and community engagement. ## **With the community** The team will continue engaging through existing channels and will introduce a monthly “what we did” discussion on GitHub. This will not only keep the community updated but also allow for broader participation and feedback, ensuring that the developments reflect the community’s needs and expectations. Work will feed into the wider CKAN Tech Team, and work of CKAN Product Manager [Alex Gostev](https://www.linkedin.com/in/alexgostev/). ## **Focus areas** Every few months, the team will outline key focus areas for the coming period. For the first tranche of work, those will be (i) DCAT v3 support, (ii) developer and maintainer experience, and (iii) file management in CKAN. ### DCAT v3 support With DCAT v3 in candidate mode and application profiles being developed in the US and the EU, frictionless support in CKAN is crucial to interoperability in open data ecosystems. We are planning out the implementation and starting work now. This is a key area and we will follow up with further announcements to gather further stakeholder input. [Issues for DCAT v3 support will be tracked here](https://github.com/orgs/ckan/projects/5). ### Developer and maintainer experience We are targeting specific improvements and new tools around the main CKAN repo and the Docker images to provide a better experience when working on CKAN, both from a developer point of view (like enabling VSCode remote debugging) and from the maintainers one (like automating backports). [Issues for developer and maintainer experience will be tracked here](https://github.com/orgs/ckan/projects/7/views/1). ### Enhanced file management There is much room for improvement in how files are managed in CKAN. Key aspects include better support for large files, separating file management from data resource management, reducing CKAN load when accessing data, and features like resumable uploads and eager data validation. Some great initial work in this direction has been done by Sergey Motornyuk, Oleksandr Cherniavskyi, and Ian Ward. **[Issues for enhanced file management will be tracked here](https://github.com/orgs/ckan/projects/6).** See the [associated project boards](https://github.com/orgs/ckan/projects?query=is%3Aopen) for each focus area for an idea of the scope of work, and feel free to jump in on Github or [Gitter](https://gitter.im/ckan/chat) to contribute ideas and feedback. ## **Looking ahead** This funding initiative is a testament to the power of strategic investment and community collaboration in the open-source ecosystem. By supporting key developers and aligning efforts with the CKAN roadmap, co-stewards Link Digital is setting the stage for substantial improvements to CKAN that will benefit users worldwide. As we look forward to the innovations and enhancements that this initiative will bring, it’s clear that the future of open data is bright, and needed more now than ever. ## About the key contributors ### Ian Ward [Ian Ward](https://www.linkedin.com/in/ianward/) is a seasoned Python developer specialising in open-source software, particularly CKAN. Since 2013, he has significantly contributed to CKAN, focusing on innovative data management features and core system enhancements. ### Adrià Mercader [Adrià Mercader](https://www.linkedin.com/in/adriamercader/) is an experienced software developer and tech lead with over fifteen years of experience in Open Data and Civic Tech. He plays a pivotal role in the CKAN community, focusing on enhancing its extensions and core functionality. ### Sergey Motornyuk [Sergey Motornyuk](https://www.linkedin.com/in/sergey-motornyuk-a33226108/), is Tech Lead at Link Digital and a vital CKAN core contributor. His work focuses on developing robust features and educational resources to empower the CKAN community. **Categories:** All articles, CKAN, Kate Sampher, Open Data, Thought Leadership **Tags:** CKAN, Community, Thought Leadership --- ### [Drupal: why organisations should use it as part of their open data management](https://linkdigital.com.au/news/2024/10/drupal-why-organisations-should-use-it-as-part-of-their-open-data-management/) **Published:** May 19, 2025 **Author:** Andrew Nette **Excerpt:** Link Digital has extensive Drupal experience. Its developers use the software to design unique and visually appealing designs for web applications. **Content:** *This blog post was co-authored by Sergey Motornyuk, Senior Solutions Architect at Link Digital.* Last modified date: April 27, 2026 ![Drupal expert - Link Digital: Why organisations should use it](https://linkdigital.com.au/wp-content/uploads/2024/10/img-blog-Drupal.jpg) As a global company focused on supporting open data, digital service design and citizen centred design practices, [Link Digital](https://linkdigital.com.au/) utilises a variety of open source software. The key one, which we talk about a lot, is [CKAN](http://ckan.org). Another vital tool that we don’t talk so much about is a powerful open source content management system called [Drupal](https://www.drupal.org/). Indeed, we often use CKAN and Drupal together in applications that involve managing and publishing data. While CKAN can be configured and set up to function as a data catalogue or open data platform once it is deployed and hosted on a web server, Drupal is deployed to help manage and present large data repositories in an attractive, interactive and user-friendly way. The following post will examine Drupal’s capabilities, including its connection with [CKAN](https://linkdigital.com.au/ckan/), why organisations choose Drupal for their content management, and how Link Digital has made it work for our clients. ## **Exploring Drupal’s functionality** Drupal is used to build websites and other web applications. It helps web developers establish ways for humans to better interact and experience data on the web, by allowing users to create, manage and organise content, including text, images, and videos, in different formats, such as web pages, blogs posts, articles, forums, and research spaces. Drupal has a functionality that can be utilised for small blogs and very basic open data portals. But where the software really comes into its own is in the building of high-traffic, enterprise-level platforms of the type needed by governments, multilateral organisations and large not-for-profits and research organisations. Its powerful features include: - A permission management system that allows users to define and set roles to a very granular level. This includes establishing detailed permissions regarding who can upload, edit and view data, including multi-stage content approval. - Tools to create efficient workflow processes, including content creation, publishing and moderation. This enables collaborative content development while ensuring published material meets any necessary internal standards. - A high degree of scalability. Drupal offers a core system, but this functionality can be extended through a variety of modules or plugins. - Built in support for creating multilingual websites and allowing users to upload and publish content in multiple languages. - Easy integration with external systems, marketing automation tools, and social media platforms, that can allow organisations to seamlessly manage data across their various platforms. - A large, active open source community that continually monitors the software and contributes to its development. Users can take advantage of this to access regular updates, new modules, and security patches, while avoiding being locked into proprietary contracts. ## **Using Drupal and CKAN together** Drupal functions well with CKAN. Drupal’s high-level user interface (UI) capabilities mean that it often serves as the front-facing user management system of a data catalogue or open data portal, while CKAN manages the backend. Users can utilise Drupal’s flexible theming and content management structure to enable users to create a visually engaging web application. This enhances the presentation of the data and creates a far more interactive, content-rich and attractive web user experience. Drupal can incorporate CKAN datasets seamlessly into other content such as blogs, articles, and tutorials. CKAN datasets can be integrated with Drupal’s extensive user permission settings to control access to datasets. As part of this, CKAN can leverage Drupal’s authentication mechanisms to allow single sign-on or role-based access. While CKAN and Drupal work well together they remain two separate pieces of software, even when they are utilised ‘under the hood’, so speak, in the same data project. As a result, while it is possible to share data between the two pieces of software, it requires a lot of hard work on the part of developers behind the scenes to make it happen efficiently. To cite one small example, when a user comes from a Drupal page to a CKAN page, the former must remain logged in as it tries to deal with CKAN. To bridge these issues, Link Digital recently developed a [CKAN Sync for Drupal module](https://www.drupal.org/project/ckan_sync) that can be added for configuration in a plug-and-play manner with any Drupal project. This allows developers to connect their Drupal site menu structure of any CKAN enabled open data management system [via what is known as a RESTful API](https://aws.amazon.com/what-is/restful-api/) (the interface that two computer systems utilise to request and send information over the Internet in a secure manner). This is an opportunity to combine the native interoperability already present in both projects in a more meaningful way. ## **Link Digital’s work with Drupal** [Link Digital has extensive Drupal experience](https://www.drupal.org/link-digital). Its developers use the software to design unique and visually appealing designs for web applications. This can include customising data catalogues and open data portals to match the client’s unique branding. We also use it to create permission settings for data stewards and content managers and utilise Drupal’s extensive extensions and plugins to extend the software’s functionality and meet client needs, including when they may want to integrate their data and digital operations with third party systems. We often use Drupal, which is often used as a ‘cover’ for CKAN. For example, when an external user lands on an open data portal, it is interacting with the Drupal part of the application. It logs into Drupal and Drupal decides whether the user has permission to go into CKAN and what exactly it can do inside once, such as view or download datasets. These datasets will be managed by the CKAN software, but the dashboards and charts that the user will be viewing data in are created and managed by the Drupal part of the application. ## **Link Digital’s Drupal work has included:** ### ***Canadian Watershed Information Network*** ![University of Manitoba & CKAN case study by Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/10/img-LP-ckan-uni-UNIM-1920-1024x576.webp) Managed by the [University of Manitoba’s Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/ "University of Manitoba's Centre for Earth Observation Science"), [the CanWIN site](https://canwin-datahub.ad.umanitoba.ca/#:~:text=CanWIN%20is%20the%20data%20centre,River%20Watershed%20to%20the%20Arctic.) is an internal data management platform that collects and manages a large array of climate data, including spatial data, and shares it with researchers. CanWIN uses Drupal to enable the site to have custom content types for datasets, project pages, research publications, etc, helping to make information storage as efficient as possible. Drupal enables users to search through the site’s datasets and content based on specific parameters like location, time, or category. And Drupal’s UI functionality provides strong visual theming and customisation, enhancing the user experience, and making data more accessible and visually appealing. ### ***Pacific Data Hub*** ![Pacific Data Hub case study by Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/10/img-LP-ckan-uni-PDH-1920-x1080-1024x576.webp) Launched in late 2020, the [Pacific Data Hub (PDH)](https://pacificdata.org/) is overseen by the [Pacific Community](https://www.spc.int/) and serves as a gateway to the most comprehensive data collection of relevance to the 22 Pacific Island nations and territories. Drupal is core to the portal’s ability to visually illustrate data searches by country or sector. This allows the portal to not only present the most relevant datasets, but a selection of charts that try and visualise the data in an informative and attractive way. ### ***Vehicle Emissions Star Rating*** ![VESR- drupal based site - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/08/www.vesr_.gov_.au_browse-1-1024x804.png) The [Vehicle Emissions Star Rating (VESR) website](https://www.vesr.gov.au/) was initiated by the New South Wales Government to assist consumers to factor in the environmental impact when planning their next vehicle purchase. It does this by using a simple star rating that enables them to compare the carbon dioxide tailpipe emissions of over 16,000 passenger vehicles. The development build was done using [Drupal](https://www.drupal.org/) and enables data to be presented in a simple, easy to use, and visually appealing format, including enabling consumers to see a star rating and image for every vehicle on the site. ## Let’s talk about your Drupal project Does your organisation need help with a Drupal project? If so, [contact us](https://linkdigital.com.au/get-in-touch/ "contact us") and tell us about your project. **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Industry, Internal data hub, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** CKAN, Drupal --- ### [My First 100 Days as a CKAN Contributor](https://linkdigital.com.au/news/2019/04/my-first-100-days-as-a-ckan-contributor/) **Published:** April 3, 2019 **Author:** Kate Sampher **Content:** *This article was authored Ruth Bekele in 2019* My experience working with the [CKAN open source project](https://ckan.org/), via a CKAN contributor role sponsored by Link Digital within [Open Knowledge Ethiopia](http://okfneth.blogspot.com/), has been a great opportunity. The working environment is friendly and helpful. My direct manager, [Solomon Mekonnen](https://x.com/solomonmekonne8), who has establish Open Knowledge Ethiopia with the support and mentorship provided by [Steven De Costa](https://twitter.com/starl3n), has been great. The [Addis Ababa University](http://www.aau.edu.et/) have also been greatly supportive of Open Knowledge Ethiopia during these early days as a new initiative. The [CKAN tech team](https://ckan.org/blog/changes-ckan-tech-team), who have guided me and helped me learn through example and direct feedback, well… I have never met a work force like this before. As one of the first CKAN contributors in Ethiopia I was highly motivated and was ready to learn and accept the challenges, even if I knew I had to go through the process mostly alone. The [CKAN documentation](https://ckan.org/documentation-and-api/) was a great help, especially for the installation process. It is user friendly and simple to understand and learn. The tech team I work with are nice and friendly. They kindly welcomed me and it was a privilege to be introduced to them by the Executive Director of [Link Digital](https://linkdigital.com.au/), Steven De Costa, right after I got the job. Having the opportunity to communicate with the tech team themselves, I was able to appreciate the benefits as well as challenges of the profession. And I have learned a lot from the [meetings we have every Tuesday and Thursday](https://hack.allmende.io/ckan-meeting) by listening, as new issues and pull requests are discussed and assigned. The tech team was willing to guide me through the process of learning and gaining confidence with CKAN. As a contributor, recently I got the chance to contribute on work to improve the CKAN instances list, which was both a bit challenging and a great experience at the same time. I am looking forward to contributing more and becoming an asset to CKAN and the tech team. In my opinion, having full time teammate working with me here in Addis Ababa will be a great help and will increase contributions to CKAN. Open Knowledge Ethiopia is currently advertising to [hire a second full time CKAN contributor](https://okfneth.blogspot.com/2019/03/open-position.html) who I will work alongside. I will be glad to share my experiences and mentor them if needed. Addis Ababa University has also agreed to provide an office for Open Knowledge Ethiopia, which will be a great opportunity for me and other new contributors as well as for Open Knowledge Ethiopia itself. My experience as a CKAN contributor has been absolutely inspirational. Since I have been able to gain a direct experience, this has given me further incentive to pursue my career as a developer and open source contributor with more passion. I would highly recommend this experience for anyone considering to becoming a CKAN contributor. CKAN is currently supported worldwide by a very small core team of developers, yet it is used by many major Governments and institutions. Our objective is to grow our small team to become a major contributor to the CKAN project and to establish Ethiopia as a location where specialist CKAN support can be sought. Solomon and I would like to deeply thank the following donors who have personally contributed to funding the first year of wages for our second CKAN Contributor: Philip Ashlock Adil Hasan Chris Jaja Patrick Lozeau Jaimie Boyd Matteo De Stefano Ashley Casovan Steven De Costa Ian Ward Joel Natividad Pia Andrews Ross Jones Sebastian Moleski Alfred Deeb Adrià Mercader Margaret De Costa Barb De Costa Marko Bocevski John Chodera Karmen Condic-Jurkic Florian Hoedt Brigette Metzler Alex Sadleir Yury Linkov Lilia Rudenko And of course, we would like to once again thank Link Digital for funding my own ongoing role and the remaining budget required to fund our second CKAN contributor on an ongoing basis. **Categories:** Open Data --- ### [Reimagining data systems for human agency](https://linkdigital.com.au/news/2025/05/reimagining-data-systems-for-human-agency/) **Published:** May 27, 2025 **Author:** Kate Sampher **Excerpt:** Imagine if you could declare exactly how you want companies to use your data, with systems that automatically verify compliance. **Content:** Think about the last time you clicked “I agree” without reading the terms. Or when you trusted a company with your data only to discover it had been shared with third parties. We’ve all accepted opaque terms from faceless entities, with little choice but to trust they’ll handle our information responsibly. This dynamic represents a fundamental challenge impacting everything from social media to government transparency. It’s a problem that Steven De Costa, founder of [Link Digital](https://linkdigital.com.au/) and co-steward of [CKAN](https://ckan.org/) the Comprehensive Knowledge Archive Network – has been thinking deeply about since 2018. ## **Flawed architecture of trust** We live in what Steven calls a “pull economy” – a system built on trust. Value and trust flow in one direction. Organizations request our trust and data while offering minimal transparency or accountability in return. This structure requires asymmetrical relationships where individuals must trust entities without adequate verification. This leaves many feeling powerless, frustrated, and resigned to a system where we have no choice but to hope for the best. When [Facebook changed its privacy settings](https://medium.com/@matthewkeys/a-brief-history-of-facebooks-ever-changing-privacy-settings-8167dadd3bd0) in 2009, millions had their previously private information suddenly made public—a stark reminder of our vulnerability. [The Cambridge Analytica scandal](https://en.wikipedia.org/wiki/Facebook%E2%80%93Cambridge_Analytica_data_scandal#:~:text=In%20the%202010s%2C%20personal%20data,of%20users%20for%20that%20purpose.) further demonstrated how easily our trust could be exploited, with data from 87 million users harvested without meaningful consent and used for political manipulation. > Trust is the language of mothers and robbers, Steven explains, pointing out how the same request, “trust me”, can come from sources with wildly different intentions. We often can’t tell what these intentions are until it is too late. This model becomes problematic at scale. In information networks, where data flows across countless nodes with minimal transparency, these trust relationships become less functional. ## **The Objective Observer Initiative** What if we could restructure these relationships? What if, instead of being pulled into trusting entities and platforms, we could push our intentions outward in measurable, accountable ways? Steven began developing this vision in January 2021, during global uncertainty that made him question fundamental assumptions about information systems. > I started to post on LinkedIn, test ideas with people, and challenge myself about how I would respond to these threats, he explains. What began as a response to shifting perceptions around openness evolved into a framework for reimagining how data, intent, and accountability could work together. Imagine if you could declare exactly how you want companies to use your data, with systems that automatically verify compliance. Instead of clicking “agree” on terms you’ll never read, you could publish your own—*I consent to my location being used for navigation only* or *My purchase history may be analyzed for recommendations but not shared*—and only interact with organizations that honor those boundaries. This is the vision behind the “[Objective Observer Initiative](https://linkdigital.com.au/news/2025/04/open-data-ckan-and-the-philosophy-behind-the-objective-observer-initiative/)“, a framework for creating a “push economy” based on honest declarations of intent rather than blind trust. The initiative consists of three components: 1. **The observer** ([OpenData.ai](http://opendata.ai)) functions as an independent verification system, collecting and analyzing evidence of whether actions match declared intentions. This creates ongoing accountability rather than one-time consent. 2. **The social experience** ([OpenData.ly](http://opendata.ly)) serves as a public registry where individuals and organizations publish their commitments, creating a permanent, searchable record of what entities claim they will do. 3. **An open source community component** enables collaborative development, ensuring the system itself remains transparent and accountable to its users. ![The Objective Observer Initiative Framework](https://linkdigital.com.au/wp-content/uploads/2025/04/Diagram-The-Objective-Observer-Initiative.png)The Objective Observer Initiative Framework Consider applying for a job. Currently, a company posts a listing with promises about workplace culture, advancement, and compensation. Applicants must trust these claims, often discovering the reality only after investing significant time or accepting the position. In Steven’s vision, the company would make explicit declarations that could be verified against objective measures. Is the company’s workforce as diverse as they claim it to be? Do they provide the work-life balance they advertise? The system would track these patterns, allowing potential employees to make informed decisions rather than relying on marketing claims. This approach flips the traditional model. Instead of organizations asking us to trust them, individuals would state: > This is who I am. These are my boundary conditions. This is how I intend to act. Those declarations become observable, measurable, and accountable. “Anyone can be honest,” Steven points out. “Any single one of the eight billion people on this planet can have a declared intent, a declared persona, a declared set of actions they’re going to take.” Applied to data systems, the Objective Observer Initiative transforms how we think about open data. Rather than a passive resource, data becomes active evidence of alignment with stated intentions. Did a government agency spend money as declared? Did a company uphold its stated values? ## **AI as the material for new structures** The Objective Observer Initiative requires sophisticated systems for monitoring intentions and actions. This is where AI becomes essential, not as a solution itself, but as the material from which solutions can be built. Steven describes AI as like “wood” – a constructive framework that can be shaped into what we choose. The question isn’t what AI can do, but what we want to build with it. Today, AI is deployed in ways that diminish human agency. Recommendation algorithms analyze our past behavior to predict what will keep us engaged, often leading us down increasingly narrow content paths. Credit scoring systems make life-altering decisions based on opaque criteria. What excites Steven is the alternative. How AI can become “very close to the skin”, i.e.,technology that embraces human intention and enhances our ability to express it clearly. Rather than predicting and manipulating us based on past behavior, AI could help us articulate and follow through on our declared intentions. > We can have a clear signal about what we want and how we might get it with technology, he says. This vision sees AI not as replacing human agency but as strengthening it – giving individuals more power to define who they are and what they want to be. ## **From CKAN to a new vision** Steven’s thinking didn’t emerge in a vacuum. As co-steward of CKAN, an open-source data management system used by governments worldwide, he has worked at the intersection of data, transparency, and public interest for more than a decade. CKAN embodies many values underpinning the Objective Observer Initiative. > What CKAN is, is a tool… It’s owned by the contributors, and it’s owned by the users. The system allows decentralized data publishing with multiple custodians, avoiding vendor lock-in while making data interoperable and discoverable. This experience showed both the potential and limitations of current open data approaches. While CKAN creates infrastructure for publishing open data, the deeper challenge remains: generating demand for that data and connecting it to meaningful accountability systems. The connection between CKAN and the Objective Observer Initiative represents an evolution—from making data available to making it actionable in service of declared intentions and public accountability. - [Facebook](https://www.facebook.com/LinkDigital) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital) «[Previous](https://linkdigital.com.au/news/2025/05/how-to-tell-stories-with-data-using-these-ckan-extensions-and-other-tools/) **Categories:** All articles, Artificial Intelligence, CKAN, Government, Higher Education/Research, Industry, Objective Observe Initiative, Open Data --- ### [Making open data AI friendly: Interview with CKAN developer, Tome Petrovski](https://linkdigital.com.au/news/2026/04/making-open-data-ai-friendly-interview-with-ckan-developer-tome-petrovski/) **Published:** April 22, 2026 **Author:** Andrew Nette **Excerpt:** Interview with Link Digital CKAN expert Tome Petrovski, on working behind the scenes on CKAN and helping to make the software more AI friendly. **Content:** - [Working behind the scenes on CKAN](#aioseo-working-behind-the-scenes-on-ckan-6) - [Link Digital: making open data more AI friendly](#aioseo-link-digital-making-open-more-ai-friendly-15) - [The future of open data and AI](#aioseo-the-future-of-open-data-and-ai-20) - [The common data challenge that doesn't get talked about](#aioseo-the-common-data-challenge-that-doesnt-get-talked-about-25) - [Lessons from working in the hospitality industry](#aioseo-lessons-from-working-in-the-hospitality-industry-29) - [More articles](#aioseo-more-articles-36) Among our global team of experts, Link Digital is lucky to have [Tome ](https://www.linkedin.com/in/tome-petrovski-0553261b6/)[](https://www.linkedin.com/in/tome-petrovski-0553261b6/)Petrovski. Based in Bitola, a city in North Macedonia, Tome has high-level experience in the full [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN) tech stack, including Flask, PostgreSQL, Solr, and React for frontend improvements. “Most of my work is focused on building and extending open data portals, like developing custom extensions, adding new features and maintaining existing functionality,” Tome says. “I also spend time fixing bugs and improving overall system behaviour. It’s a role that lets me work on a variety of problems, which I really enjoy.” Tome is now working on [Link Digital’s ‘Ask AI’ feature](https://linkdigital.com.au/ask-ai/), our new AI-powered layer on top of [CKAN](https://linkdigital.com.au/ckan/) that seeks to make data portals more conversational, contextual, and semantically searchable. I spoke to Tome about his work, his thoughts on making CKAN and the open data hosted on it more readable to AI agents that crawl portals and other specialised analytical tools, and how the 20 years he spent in the hospitality industry prior to joining Link Digital was perfect training for his current role as a software engineer. ## **Working behind the scenes on CKAN** In his time with the company, Tome has worked on many extensions. “Link Digital maintains quite a few [custom CKAN extensions](https://github.com/DataShades/), and a big part of my work involves adding new features, fixing bugs and improving overall system behaviour.” Some of these extensions include [*ckanext-charts*](https://github.com/DataShades/ckanext-charts), that enables users to create and manage interactive data visualisations directly within the platform, and [*ckanext-xloader*](https://github.com/ckan/ckanext-xloader), a CKAN extension that automatically loads data into the DataStore. But the work Tome is most proud of is his contribution to the [*Flask-Login integration*](https://flask-login.readthedocs.io/en/latest/), which also happens to be the most commented upon pull request in CKAN history. The Flask-Login integration is the layer that allows users to authenticate in a portal, including managing user session login/logout and a ‘remember me’ functionality for Flask, a lightweight, open-source micro web framework for Python, designed to build web applications and APIs. Before the upgrade, this function was handled by an authentication library that had been unmaintained for years. “It still worked but it had effectively become a black box within the community. No one fully understood how it behaved internally and that made it risky to modify or extend. No one was tackling bugs or adding new features.” “So, I took on the task of replacing it with the Flask Login integration, which is a much better fit for the Flask architecture.” From a user’s point of view, nothing changed, but from a developer’s perspective, it replaced an unmaintained black box library with a modern, popular, and widely used extension that is a better fit for the CKAN flask-based architecture. The main technical challenge of this eight-month-long project was ensuring backward compatibility with existing extensions that depended on implicit behaviour from the old system. “A lot of existing extensions depended on implicit behaviour from the old system. So, we had to carefully replicate that behaviour to avoid breaking things. The work ended up being quite evolved. It ran for about 8 months with many review cycles, and it eventually became the most commented pull request in CKAN’’s history.” [*Also read: Link Digital CKAN experts – global impact in 2025*](https://linkdigital.com.au/news/2025/11/link-digital-ckan-experts-global-impact-in-2025/) ## **Link Digital: making open data more AI friendly** Tome is one of the Link Digital CKAN developers now working on our new AI-powered layer for CKAN, Ask AI. “The knowledge assistant is essentially an AI powered layer that allows a user to interact with open data in a much more natural way. Instead of manually searching through the data sets, users can ask questions and get direct, relevant answers. My work has focused on building the core engine behind it. How we retrieve the right information, generate accurate responses and ensure the system works reliably with the types of data typically found in CKAN portals.” “One of the key priorities has been security. Since a lot of this data can be sensitive, we designed the system to support fully local deployment. This means the data never leaves the organisation’s infrastructure. While Ask AI also supports third party providers like OpenAI, the main goal is to give organisations the flexibility to keep everything in-house if needed.” “I think open data portals have always had a discoverability challenge. You know the data is there, but finding and understanding it often requires some kind of technical knowledge. This kind of AI layer removes that barrier, making the data more accessible to a much wider audience. And doing that securely is what makes it truly viable for government and public sector use.” ## **The future of open data and AI** While Tome believes that the Ask AI feature is a major step in the right direction in terms of better aligning CKAN and open data management with advances in machine learning, through things like enabling smarter search and automatic metadata generation, it is “still relatively early stages.” “One area I find particularly interesting is data quality. I think AI can make that much more intelligent, like going beyond validation rules to actually understanding the context of the data, then flagging inconsistencies that wouldn’t normally be caught and even suggesting improvements to publishers before data is submitted.” “So, more broadly, I think there’s an opportunity to make systems more proactive… and guide publishers to produce higher quality data sets and reduce the manual effort involved on both sides. I believe that kind of intelligent layer could really raise the overall standard and make open data platforms more useful and accessible.” *[Also read: What is the future of open data in the AI era?](https://linkdigital.com.au/news/2026/03/what-is-the-future-of-open-data-in-the-ai-era/)* ## **The common data challenge that doesn’t get talked about** Tome’s work on Ask AI links to a much broader belief that discoverability is one of the core challenges facing organisations with their data portals. “Organisations put a lot of effort into collecting and publishing data. But once the data is there, it often just sits unused. So, finding it and understanding it requires a level of guidance that most users don’t really have.” Prior to Ask AI, “users were mostly limited to search filters or already knowing what they were looking for. Which means a lot of valuable data effectively stays hidden unless you’re familiar with the system.” This means that while their data is technically open, “in practice it’s not really accessible to everyone and I think that gap doesn’t get enough attention because the focus is usually on publishing the data rather than what happens after \[it has been published\].” “That’s actually a big part of what motivated [Ask AI.](https://linkdigital.com.au/news/2026/03/ask-ai-link-digitals-ai-layer-for-smarter-ckan-portals/) We are trying to bridge that gap and make data generally usable while still making it secure for government and public sector organisations to adopt.” ## **Lessons from working in the hospitality industry** Before transitioning into full-time software engineering, Tome worked for many years in the hospitality industry. It’s an experience he believes has been directly relevant to his job as a CKAN developer for Link Digital. “I spent about 20 years in hospitality, starting when I was 18 and eventually managing cafes, restaurants and nightclubs. Honestly, that experience shaped me just as much as any technical training. Because running a venue is all about coordinating people, keeping the operation moving under pressure and staying organised when multiple things are happening at once. A lot of those skills translate directly into software engineering. Basically, you still need discipline, clear communication and the ability to stay calm and focused when something breaks at the worst possible time.” “So, I think, yeah, coming into engineering with that kind of background was an advantage. I wasn’t just learning to code, I was already used to solving problems and delivering under real world constraints, which is ultimately what the job is.” “The direction things are headed, the intersection of open data and AI feels like a genuinely important space, and I feel fortunate to be working in it.” **Interested in making your open data more machine-readable?** [Get in contact to discuss how Ask AI can improve your users’ interactions with data.](https://linkdigital.com.au/get-in-touch/) ## **More articles** - [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/)Rising bot traffic distorts analytics and increases infrastructure load, and a large share of it, around 40%, is also actively malicious. - [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/)CKAN 2.12 has been officially released. Link Digital’s CKAN experts contributed directly to several of the software’s news features. See what’s new. - [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/)It’s no secret that as the open data movement enters its third decade, traditional data platforms are dealing with a profound structural shift. For the past twenty years, open data portals operated primarily under a static storage model. Organisations collected data, structured it into standard tabular or geospatial formats, assigned basic administrative metadata, and uploaded it to public portals for humans to download and share. However, the exponential growth of machine learning (ML) and autonomous AI agents exposes vulnerabilities in these traditional repositories. When autonomous AI agents or ML models ingest raw data files that have been stripped of their original […] [Continue Reading](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) - [When the visitors aren’t human: What rising bot traffic means for your data portal](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/)This guide explains bot traffic trends, who runs the bots, and how portal owners can balance discoverability with robust defenses. - [From open data to verifiable honesty: An experiment you can look at](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/)For many years the promise of open data was simple: make your data public, make it shareable, and good things follow. I still believe this. But the question now is, can you trust the data and the sources it came from? We are surrounded now by so much content that looks credible but is not. AI can produce a confident answer from a source that, in many cases, no one can check or verify. To cite one example of the impact of this, of the more than 1,600 biomedical researchers from 80 countries that took part in a 2024 international survey, […] [Continue Reading](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) **Categories:** All articles, Artificial Intelligence, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Government, Higher Education/Research, Industry, Internal data hub, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** Ask AI, CKAN, open data, Tome Petrovski --- ### [Planning your data infrastructure? The benefits of open source compared to proprietary software](https://linkdigital.com.au/news/2026/03/benefits-of-open-source-compared-to-proprietary-software/) **Published:** March 31, 2026 **Author:** Andrew Nette **Excerpt:** From data ownership to cost effectiveness, security and transparency: comparing the benefits of open source vs proprietary software **Content:** Open source software (OSS) has a rapidly increasing share of the global software market. [According to a leading market research company, the global open source services market size had reached US$40.6 billion in 2025, a trend that is expected to continue](https://www.imarcgroup.com/open-source-services-market). This growth includes growing uptake by the private sector, including smaller enterprises, and the rise of what are known as permissive open source licences that impose minimal restrictions on software users by allowing them to incorporate the OSS into proprietary applications. OSS has a source code that anyone can inspect, modify, and enhance, as opposed to proprietary software, for which the source code is exclusively controlled by the person, team or organisation that created it. But despite its uptake, many organisations and businesses remain wary of using OSS for a variety of reasons. Let’s briefly overview the key areas in which OSS can provide superior outcomes in the management of your data infrastructure needs, compared to proprietary solutions. ## **Cost effectiveness** Proprietary software providers are primarily focused on increasing their market share and often charge high upfront costs or reoccurring subscription fees. As a result, scaling or modifying proprietary data infrastructure can be expensive and usually requires buying more licenses or products. OSS is free to download and use. There are no licensing fees per user, which allows for scaling without increased software costs. Financial outlays are instead associated with the costs of hosting and customisation by a third-party service provider, and/or the technical skills and workforce upskilling to use it. These are much less than the typical license fees associated with proprietary software and are a constant regardless of the solution you are using. Additional cost savings can also be generated through the software’s interoperability, easier integration and customisation, and reduced barriers to reuse. [This emphasis on cost savings is particularly pronounced in sectors like government/public sector (92%), retail (67%), banking (62%), telecoms (60%), and manufacturing (57%)](https://www.developer-tech.com/news/enterprise-open-source-adoption-soars-despite-challenges/ "This emphasis on cost savings is particularly pronounced in sectors like government/public sector (92%), retail (67%), banking (62%), telecoms (60%), and manufacturing (57%)"). ## **Transparency and avoiding vendor lock-in** The fact that proprietary software is restricted or closed prevents users from accessing, modifying or distributing the code. It also means you have no choice but to trust the vendor’s word that they are handling your data securely, and the software does only what it claims. Indeed, their focus on market share means proprietary vendors have a financial incentive to make their tools work best, often *only*, with their own suite of products. Likewise, if the company folds or shifts focus, the software can become ‘[abandonware](https://www.merriam-webster.com/dictionary/abandonware#:~:text=software%20that%20is%20no%20longer%20sold%20or%20supported%20by%20its%20creator)’, leaving you with unsupported, vulnerable tools, or forcing you to migrate to another solution at a potentially high cost. This is known as [‘vendor lock-in’,](https://linkdigital.com.au/news/2024/05/government-open-data-portals-a-look-at-ckan-and-socrata/#:~:text=and%20metadata%20catalogues.-,Vendor%20lock%2Din,-Proprietary%20software%20that) when users become dependent on a specific vendor for updates, support and maintenance, and compatibility with other software and, and cannot easily switch to an alternative solution or another vendor. [One recent survey of IT professionals primarily in the United States, the United Kingdom, and Germany, found that 94% of them were concerned about vendor lock-in.](https://www.parallels.com/products/ras/all-resources/reports/cloud-survey-2026/report/? "One recent survey of IT professionals primarily in the United States, the United Kingdom, and Germany, found that 94% of them were concerned about vendor lock-in.") OSS eliminates the risk of vendor lock-in by giving users the freedom to modify, upgrade, tailor or combine software solutions. Because it is public and fully accessible, anyone can inspect the source code of OSS for security backdoors, privacy leaks, or ‘phone home’ features (mechanisms built into software that automatically send data from your device back to the developer’s servers). Similarly, you own your data and tools. If a developer stops supporting the project, the community (or your own team) can fork the code and keep it alive. ![Digital sovereignty: open source vs proprietary software](https://linkdigital.com.au/wp-content/uploads/2026/03/Digital-sovereignty_Open-data-vs-proprietary--1024x576.webp) ***[Also available to read on Link Digital’s site: open source software and mapping digital public infrastructure globally.](https://linkdigital.com.au/news/2025/12/interview-mapping-digital-public-infrastructure-globally/ "Also available to read on Link Digital's site: open source software and mapping digital public infrastructure globally.")*** ## **Easy customisation** The fact that proprietary software is a closed system, and users are dependent on whatever preset options or application programming interfaces the vendor provides, makes it complex, time consuming and expensive to modify to meet your changing needs or integrate new applications. [OSS components, like CKAN, are designed to be modular](https://linkdigital.com.au/ckan/ "OSS components, like CKAN, are designed to be modular"). Users can swap one component for another without having to rebuild their entire data infrastructure. This makes OSS highly customisable and enables users to vastly increase its basic functionality and integrate seamlessly with a user’s existing data and digital operations. ## **Enhanced security and code transparency** With proprietary solutions, all security updates and maintenance are handled by the vendor’s internal team. OSS, on the other hand, [can be made highly secure by proper configuration](https://linkdigital.com.au/services/secure-data-exchange/) and adherence to best practice security protocols and access controls within the host organisation, as well as by engaging the expertise of a third-party service provider. The fact that open source solutions deliver complete source code transparency promotes visibility and that maximises the number of individuals examining the code. With more people checking the code, any vulnerabilities can be identified quickly, leading to fast updates and strong security practices. Most OSS products, like CKAN, can also draw on a global community of developers and users that constantly audits the code. This user base also provides support, advice and resources to in-house developers, and oversees the regular release of security patches and updates to address vulnerabilities and improve overall security. This means vulnerabilities are often caught faster than a single company can do. ## **Innovation that is not reliant on your vendor** For proprietary software solutions, innovation happens at the pace of the vendor’s internal R&D cycle and is often dictated by their financial bottom line and market interest rather than user needs. In contrast, ideas flow across the OSS community. New features and patches are regularly released because contributors from different companies and organisations collaborate. [Link Digital](https://linkdigital.com.au/) would argue OSS is particularly suited to public sector governance data management needs. OSS’s flexibility and easy customisation offers the potential to leverage collaboration between government and the broader digital ecosystem, for example, between public officials and the open source communities. This not only exposes governments to a wider base of IT talent, but to new skills and ways of working, with flow on impacts in terms of improved data management and data informed decision making skills. ## **Data ownership** While you own the content of your data, in proprietary solutions the vendor controls the infrastructure. If the vendor changes their terms of service, for example, to train AI models on your proprietary data, you may have little legal recourse other than to stop using the service. OSS is in sync with the shift taking place from data ownership to digital sovereignty. For organisations that increasingly rely on AI and cloud-based systems, a vital question becomes not ‘who has the file?’ but ‘who controls the life cycle, access, and legality of the data?’ With OSS you own the entire tech stack. You decide where the data is stored (on-premises or in a specific jurisdiction), who can access it, and how it is processed. This also means that users decide whether their data is used for AI training. Similarly, the data is in open, readable formats, meaning that if you decide to stop using a specific open-source tool, your data remains in a universal format, allowing you to move it around, as you need. ## **Interoperability and open standards** Proprietary software often uses a closed ecosystem or secret file formats which are designed and maintained by the owner. This makes it difficult for users to switch to a competitor’s product. If a proprietary vendor goes bankrupt or discontinues a product, your data can effectively be left in a file format that no other software on earth can understand. While proprietary software often uses compatibility as a competitive lever, OSS treats it as a foundational requirement. OSS prioritises open standards to ensure they can integrate with a wide variety of other tools. Because the code is public, any developer can build a bridge to it. This also means that if an open-source project stops being updated, your data is still stored in a standard, readable format. You can simply use a different tool to open it. ## **Open source: the right choice for your data infrastructure** Choosing the right open data platform is critical. OSS offers extensive benefits over proprietary systems, including unmatched customisation, avoidance of vendor lock-in, and full data control, including the ability to decide whether your data is used for AI training. By opting for OSS, organisations can not only meet their current data needs but also future proof their digital infrastructure for emerging challenges and opportunities. ## **Case study: from proprietary to open source** Interested in making the switch from proprietary to OSS? [Read our interview with Miles Dunkin](https://linkdigital.com.au/news/2026/03/from-proprietary-to-open-source-a-new-zealand-government-agencys-journey-with-ckan/), data manager of the [Resource Markets Branch of New Zealand’s Ministry of Business, Innovation and Employment](https://www.mbie.govt.nz/building-and-energy/energy-and-natural-resources), about how they replaced the proprietary software used to run its online data storage platform, with the open source [CKAN](https://ckan.org/), and the benefits this brought. [Message Link Digital](https://linkdigital.com.au/get-in-touch/) ## **More articles** - [From proprietary to open source: A New Zealand government agency’s journey with CKAN](https://linkdigital.com.au/news/2026/03/from-proprietary-to-open-source-a-new-zealand-government-agencys-journey-with-ckan/) - [What is the future of open data in the AI era?](https://linkdigital.com.au/news/2026/03/what-is-the-future-of-open-data-in-the-ai-era/) - [Making data portals user-friendly: a conversation with a UI/UX expert](https://linkdigital.com.au/news/2026/03/making-data-portals-user-friendly-a-conversation-with-a-ui-ux-expert/) - [Ask AI: Link Digital’s AI layer for smarter CKAN portals](https://linkdigital.com.au/news/2026/03/ask-ai-link-digitals-ai-layer-for-smarter-ckan-portals/) **Categories:** All articles, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Government, Higher Education/Research, Non-profit/NGO, Open Data **Tags:** CKAN, Digital public infrastructure, open data --- ### [How to create blueprints (CKAN Extensions)](https://linkdigital.com.au/news/2024/06/ckan-extensions-creating-a-blueprint/) **Published:** June 18, 2024 **Author:** Brett Jones **Excerpt:** Each Blueprint functions like a mini application that can be registered with the main Flask application. This modular approach helps in organising code, reducing redundancy, and improving maintainability. **Content:** **­­­**This article is written by Brett Jones, CKAN contributor at [Link Digital](https://linkdigital.com.au/) ## **What are Blueprints?** In Python Flask, a Blueprint is a way to organise your application into modules, which can have their own routes, static files, and templates. Each Blueprint functions like a mini application that can be registered with the main Flask application. This modular approach helps in organising code, reducing redundancy, and improving maintainability. ## **Analogy** Imagine that your Flask application is like a big public library. A library has different sections, such as fiction, non-fiction, science, history, etc. Each section has its own set of books, staff to manage the section, and layout. Although each section operates somewhat independently, they are all part of the same library. ### In this analogy:­­­ - **The entire library** is your main Flask application. - **Each section (fiction, non-fiction, etc.)** is a Blueprint. Each section (Blueprint) has its own books (routes), staff (views and templates), and layout (static files and resources). - **The library’s management system** that oversees all sections and ensures they work together seamlessly is akin to the main application that registers and coordinates the Blueprints. ## **Benefits of using blueprints** 1. **Modularity**: Code for different parts of your application can be split into separate Blueprints, making it easier to manage and understand. 2. **Reusability**: Blueprints can be packaged and reused across different projects. 3. **Scalability**: As your application grows, you can keep adding new Blueprints without cluttering your main application file. 4. **Separation of Concerns**: Each Blueprint can encapsulate a specific feature or functionality of your application, promoting cleaner code architecture. ## **Blueprints in CKAN** In my CKAN extension (pigeon) example I will create a blueprint to display a new page using a new URL route. When you create a new CKAN extension Blueprints are available by default, however, they are not activated. To activate blueprints you need to uncomment the “**plugins.implements(plugins.IBlueprint)**” line within the **PigeonPlugin** class in the **plugin.py** file plus you need to uncomment the “**import ckanext.pigeons.views as views**” line also. The **get\_blueprint()** method provides the Flask blueprint by calling **get\_blueprints()** from the **views** module of the **pigeon** extension. This is essential for adding new routes and views to CKAN ![](https://linkdigital.com.au/wp-content/uploads/2024/06/image-3-838x1024.png) The main blueprint code (below) defines a Flask blueprint named “pigeon” and adds a single route to it. ## Here’s a detailed summary: 1. **Import Blueprint**: The **Blueprint** class is imported from the Flask package. 2. **Create Blueprint**: A new blueprint named “pigeon” is created. 3. **Define Route Function**: A function page is defined, which returns a specific string when called. 4. **Add URL Rule**: The page function is linked to the URL path **/pigeon/**page within the blueprint. 5. **Return Blueprints**: The **get blueprints** function is defined to return a list containing the pigeon blueprint. In essence, this code sets up a reusable component (a blueprint) in a Flask application, which can be registered to a Flask app to handle requests to **/pigeon/page**. ![](https://linkdigital.com.au/wp-content/uploads/2024/06/image-4.png) Now if we access the URL, we see the following output: ![](https://linkdigital.com.au/wp-content/uploads/2024/06/image-6.png)![Screenshot- local host](https://linkdigital.com.au/wp-content/uploads/2024/06/image-5.png) That’s all. You can also watch the video version of this article, [CKAN Extensions: Creating a blueprint](https://www.youtube.com/watch?v=95u12RmB4FM&list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx&index=3&t=112s&pp=gAQBiAQB) on the Link Digital [YouTube channel](https://www.youtube.com/@link-digital). --- **Related articles** - [How to install CKAN using Docker Containers](https://linkdigital.com.au/news/2024/04/how-to-install-ckan-using-docker-containers/) - [How to install DataStore and DataPusher on CKAN](https://linkdigital.com.au/news/2024/05/how-to-install-datastore-and-datapusher-on-ckan/) - [Create a CKAN development environment and install a new extension](https://linkdigital.com.au/news/2024/05/create-a-new-ckan-development-environment-and-install-a-new-extension/) - [Introduction to updating CKAN templates](https://linkdigital.com.au/news/2024/05/introduction-to-updating-ckan-templates/) - [Using the CKAN Plugins Toolkit](https://linkdigital.com.au/news/2024/06/using-the-ckan-plugins-toolkit/) **Categories:** All articles, CKAN, Resources, Tutorial **Tags:** CKAN --- ### [Fifteen times faster: CKAN 2.12 to revolutionise large dataset downloads](https://linkdigital.com.au/news/2025/11/ckan-2-12-faster-search-large-dataset-downloads/) **Published:** November 10, 2025 **Author:** Kate Sampher **Content:** This article is co-authored by [Ian Ward,](https://www.linkedin.com/in/ianward/) Senior Solutions Architect/CKAN Expert at [Link Digital](https://linkdigital.com.au/). - [The 30-minute nightmare](#aioseo-the-30-minute-nightmare) - [A 15x leap forward](#aioseo-a-15x-leap-forward) - [Advanced query filters](#aioseo-advanced-query-filters) - [What this means for CKAN users](#aioseo-what-this-means-for-ckan-users) - [Work with the CKAN experts at Link Digital](#aioseo-partner-with-the-ckan-experts-at-link-digital-29) If you’ve ever tried to download a massive dataset from the Datastore, you know the frustration: long waits, spinning wheels, and dreaded timeouts. This is why Link Digital is so excited to announce a milestone update coming in CKAN 2.12 that will deliver a **15x performance boost** to large data downloads. ![CKAN 2.12: Now 15x faster for million dataset downloads ](https://linkdigital.com.au/wp-content/uploads/2025/11/1-15xfaster-2-1024x535.webp) ## The 30-minute nightmare Let’s talk about a real-world example: a social indicators dataset with **13 million records**. This was one of the datasets involved in a recent project, upgrading the [Inter-American Development Bank’s (IDB) open data catalogue](https://linkdigital.com.au/case-studies/inter-american-development-bank-open-data-catalogue/#:~:text=Impact%3A%20IDB%20Global%20Data%20Transformation), including migrating the platform from proprietary software to a CKAN-powered solution. On a standard CKAN instance, attempting to download this file via the Datastore dump could take **30 minutes or more**. And that’s if it didn’t fail with a timeout first. This wasn’t just a minor bug; it was a fundamental limitation in how CKAN retrieved data that was identified by one of our developers, [Yan Rudenko](https://www.linkedin.com/in/yan-rudenko-03783a112/). The problem was a method called **offset pagination.** This method, in simple terms, told the database to skip the first X million rows and give me the next batch. As the download progressed, the number of rows to skip grew larger and larger, forcing the database to do more and more work for each new page. This process becomes exponentially slower and grinds the server to a halt on massive exports. ## A 15x leap forward That 30-minute nightmare is now a **2-minute** task. Thanks to a groundbreaking new implementation, that same 13-million-record dataset now downloads in just two minutes. This 15x improvement is achieved by replacing the old, inefficient method with **[keyset pagination](https://www.merge.dev/blog/keyset-pagination#:~:text=cons%2C%20and%20more.-,What%20is%20keyset%20pagination%3F,-It%E2%80%99s%20a%20pagination)**. Instead of slowly counting millions of rows to skip, keyset pagination is much smarter. It uses the database’s indexed ID field to instantly jump to the correct starting point for the next page of data. It’s efficient, it’s scalable, and it means the time to get the *last* page of data is just as fast as getting the *first*. ## Advanced query filters This massive performance boost is just the beginning. This work was integrated with an even more powerful feature also coming in CKAN 2.12: the new **Advanced Query Filter** specification. This is a game-changer for anyone who interacts with data on CKAN. For the first time, you’ll be able to build complex, sophisticated queries directly. This new feature allows for: - **Range queries:** Find all data where ‘age’ is greater than 24 or ‘year’ is between 2010 and 2019. - **Complex logic:** Easily combine filters with nested AND / OR conditions for truly granular results. - **A unified language:** A common, powerful way to filter data across CKAN, making it more predictable and developer friendly. This new filtering capability – the result of work by Link Digital’s Senior Solutions Architect [Adrià Mercader](https://amercader.net/), is what helps power the new pagination, but it also unlocks a new world of possibilities for search and data discovery. ## What this means for CKAN users This is more than just increasing speed with which CKAN downloads data; it’s about reliability and power. For data publishers and users, this means: - **No more timeouts:** Large dataset downloads via the Datastore dump will just *work*. - **Faster access to data:** Users will have the data they need, when they need it, without the frustrating wait. - **Deeper, smarter search:** The new filters will unlock new ways to discover and analyse data. These powerful features have been brought together by Link Digital’s Senior Solutions Architect [Ian Ward](https://www.linkedin.com/in/ianward/) and are slated to be part of the upcoming **CKAN 2.12** release. Get ready for a faster, smarter, and more reliable CKAN. ## **Work with the CKAN experts at Link Digital** Want to talk about how CKAN can meet your data needs? [Get in contact and tell us about your project](https://linkdigital.com.au/get-in-touch/), and one of our data experts will be in touch. **Categories:** All articles, CKAN, Environmental/Climate Change, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** CKAN --- ### [Let's talk about geospatial data management and CKAN](https://linkdigital.com.au/news/2024/08/lets-talk-about-geospatial-data-management-and-ckan/) **Published:** September 29, 2025 **Author:** Andrew Nette **Excerpt:** Let’s examine the functionality that extensions can bring to CKAN and its ability to integrate with software options that are more tailored to supporting advanced geospatial insights. **Content:** Adria Mercader, a CKAN expert, is a co-author of this blog post. CKAN – the [Comprehensive Knowledge Archive Network](https://ckan.org/), has a global reputation as open-source software that can power data portals and internal data management platforms. [CKAN](https://linkdigital.com.au/ckan/) is highly customisable [through a wide variety of extensions](https://extensions.ckan.org/) that vastly increase the software’s out-of-the-box functionality and seamlessly integrate it with a user’s existing data and digital operations. These include extensions for CKAN that allow users to present and explore information from geospatial data. And while CKAN on its own cannot extract advanced insights from geospatial data, it can seamlessly integrate with open-source software options that can do this. Let’s examine the functionality that these extensions can bring to CKAN and its ability to integrate with software options that are more tailored to supporting advanced geospatial insights. ## **What are geospatial data management tools?** The [American Association for the Advancement of Science](https://www.aaas.org/) (AAAS) defines geospatial data as any data that has a geographical location component, and geospatial technologies as those ‘[used to describe the range of modern tools contributing to the geographic mapping and analysis of the Earth](https://www.aaas.org/programs/scientific-responsibility-human-rights-law/overview-geospatial-project)’. The concept ‘geospatial’ can be used interchangeably with another common term, ‘spatial’, although technically the latter is a much broader idea that relates to the placement of objects in a space. The AAAS notes that geospatial technologies have grown vastly in terms of sophistication, to the current situation where there is a network of government, scientific and commercially operated satellites with the capacity to take images of the earth’s surface and human activities on it. ‘Computers allowed storage and transfer of imagery together with the development of associated digital software, maps, and data sets on socioeconomic and environmental phenomena, collectively called geographic information systems (GIS). An important aspect of a GIS is its ability to assemble the range of geospatial data into a layered set of maps which allow complex themes to be analyzed and then communicated to wider audiences. This ‘layering’ is enabled by the fact that all such data includes information on its precise location on the surface of the Earth, hence the term “geospatial”.’ The value of geospatial data tools is their ability to add an enhanced layer of accessibility and understandability. Data can be presented in the form of different maps, for example, point or proportional symbol maps, cartograms, as well as standard topographical maps. Viewing data in this way, rather than in a spreadsheet or table, makes it far easier to see events linked to specific geographic locations and identify and analyse related trends and patterns, including in real time. ![A screenshot of a geospatial interface](https://linkdigital.com.au/wp-content/uploads/2024/08/img-set-region-of-interest-1024x637.png)A screenshot of a geospatial interface ## **CKAN and geospatial data** [CKAN](https://linkdigital.com.au/ckan/) has two extensions that are related to the presentation and exploration of geospatial data, i.e., displaying the data or the spatial extent of the data on a map. Both of these extensions are easy to install and designed to integrate seamlessly with the user’s existing data tooling. The first of these is [ckanext-geoview](https://github.com/ckan/ckanext-geoview/). This offers view plugins for CKAN that add the functionality to preview common geospatial data software formats in a web map, including [GeoJSON](https://geojson.org/), [ArcGIS Rest](https://developers.arcgis.com/rest/), API endpoints, and [Web Map Service](https://www.ogc.org/standard/wms/). The second, [ckanext-spatial](https://github.com/ckan/ckanext-spatial), has two main functionalities. It helps CKAN understand a location associated with a dataset, for instance, a pair of coordinates, a bounding box for the dataset extent, or an arbitrary polygon. These geometries are then indexed, allowing users to perform spatial searches for datasets that fall within an area of interest. In addition, it includes harvesters that allow for the importation of common geospatial metadata formats, making them discoverable as CKAN datasets. Beside the functionality provided by these two extensions, CKAN’s great flexibility and extensibility means that more powerful features can be easily integrated with other geospatial tools. For example, importing or exporting CKAN datasets to geospatial catalogues built with [TerriaJS](https://www.terria.io/), publishing geoservices with [GeoServer](https://geoserver.org/), or leveraging the [PostGIS](https://postgis.net/) geoprocessing capabilities to process data. ## **Link Digital helps organisations use geospatial tools to improve their data management** Link Digital can tailor a reliable, cost-effective solution to the challenges of better managing and sharing data, both externally and internally, including getting the most out of CKAN’s geospatial data related extensions and integrating the software with more powerful geospatial tools. Examples include: *Columbia Basin Water Hub* The[ Columbia Basin Water Hub](https://data.cbwaterhub.ca/) is an open data portal developed by [Living Lakes Canada](https://livinglakescanada.ca/) (LLCA), a non-government water stewardship organisation with over 20 years of experience protecting freshwater in Canadia’s Columbia Basin region. It collects, catalogues and makes accessible new and historical data, including geospatial and spatial data, for decision-makers, researchers, students, professionals, and the public. *Canadian Watershed Information Network* Managed by [University of Manitoba’s](https://umanitoba.ca/) [Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/), the [Canadian Watershed Information Network (CanWin)](https://canwin-datahub.ad.umanitoba.ca/) is an internal data management platform to collect and manage climate data, including geospatial data, and analyse and share it with researchers. Link Digital overhauled the existing CKAN-based platform to facilitate greater data storage capability, improved search efficiency, and new data visualisation tools, including the use of geospatial data, to enable researchers to tell more complex stories about their work. *Pacific Data Hub* Overseen by the [Pacific Community](https://www.spc.int/), the [Pacific Data Hub](https://pacificdata.org/) is the most comprehensive data collection of relevance to the 22 Pacific Island nations and territories. It allows data to be searched by country or subject and presented in different visual ways, including geospatially. *SEED Portal* The New South Wales Government’s [Sharing and Enabling Environmental Data (SEED)](https://www.seed.nsw.gov.au/) portal is designed to better categorise and share the State’s environmental data with the public. SEED allows its users to define a geographic boundary for datasets, which assists in filtering data searchers by location, and to view data geospatially in map form and as layers from datasets. ## Related case studies - [Columbia Basin Water Hub](https://linkdigital.com.au/case-studies/columbia-basin-water-hub/) - [Canadian Watershed Information Network](https://linkdigital.com.au/case-studies/canadian-watershed-information-network-canwin/) - [New South Wales’ SEED Hub](https://linkdigital.com.au/case-studies/sharing-and-enabling-environment-data-portal/) - [Pacific Data Hub](https://linkdigital.com.au/case-studies/pacific-data-hub/) ## **Get in touch** Do you have a data project that needs to present and explore information from geospatial data? [If so, please get in contact and tell us about your project](https://linkdigital.com.au/get-in-touch/), and one of our data experts will be in touch. **Categories:** All articles, CKAN, Environmental/Climate Change, Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data, Technology Infrastructure **Tags:** CKAN --- ### [Government Open Data Portals: a look at CKAN and Socrata](https://linkdigital.com.au/news/2024/05/government-open-data-portals-a-look-at-ckan-and-socrata/) **Published:** July 24, 2025 **Author:** Kate Sampher **Excerpt:** This post explores why governments might consider CKAN, an open-source platform, over proprietary alternatives like Socrata. **Content:** - [Global adoption of CKAN](#aioseo-global-adoption-of-ckan) - [Avoiding vendor lock-in](#aioseo-avoiding-vendor-lock-in) - [The role of open source in public digital infrastructure](#aioseo-the-role-of-open-source-in-public-digital-infrastructure) - [Full control over data](#aioseo-full-control-over-data) - [Extensibility and customization](#aioseo-extensibility-and-customization) - [Support for open data standards](#aioseo-support-for-open-data-standards) - [Comparing key functionality](#aioseo-comparing-key-functionality) - [In closing](#aioseo-in-closing) ## Global adoption of CKAN CKAN is trusted and utilized by numerous government agencies worldwide, reflecting its robustness and versatility. In the USA, the federal government’s primary data portal, [data.gov](http://data.gov), uses [CKAN](https://linkdigital.com.au/ckan/) to manage and disseminate vast amounts of data across various sectors, serving as a testament to its reliability and scalability. Other notable adoptions include portals like [data.gov.uk](http://data.gov.uk) in the United Kingdom, [data.europa.eu](https://data.europa.eu/en) in the EU, [datos.gob.es](http://datos.gob.es) in Spain, [search.open.canada](https://search.open.canada.ca/opendata/), [govdata.de](https://www.govdata.de/) in Germany, and United Nations Office for the Coordination of Humanitarian Affairs’s [data.humdata.org](https://data.humdata.org/), all of which highlight CKAN’s global appeal and effectiveness in meeting diverse governmental data needs. ## Avoiding vendor lock-in Vendor lock-in occurs when customers are dependent on a vendor for products and services and cannot easily switch to another vendor without substantial switching costs and inconvenience. CKAN, being open-source, eliminates this risk, empowering governments with the freedom to modify, upgrade, or tailor their solutions as they see fit without incurring prohibitive costs. Proprietary systems like Socrata can lead to a dependency on the vendor for updates, improvements, and even data hosting, which can be both limiting and costly over time. ## The role of open source in public digital infrastructure Open source software plays a vital role in building and maintaining public digital infrastructure. It promotes transparency, accountability, and participation by allowing independent verification of security and functionality. CKAN, [recognised as a digital public good](https://ckan.org/blog/ckan-is-now-a-digital-public-good), exemplifies the benefits of open source in public administration by encouraging innovation, reducing costs, and increasing the reliability of digital services. Conversely, proprietary models like Socrata can constrain innovation and adaptation due to their closed ecosystems. ## Full control over data Data sovereignty is crucial for government agencies. It involves having full control over the location, accessibility, and management of data. [CKAN](https://linkdigital.com.au/ckan/) solutions enable governments to host their data as they choose, use any preferred standards for data security, and integrate seamlessly with their existing infrastructure. On the other hand, using a service like Socrata often means that data is stored on the vendor’s servers, which can create concerns about data security, access, and governance. ## Extensibility and customization Extensibility in an open data platform refers to the ability to adapt and extend functionalities to meet specific needs. CKAN’s open-source framework allows full customization from the appearance to the underlying functionality. This flexibility ensures that any unique requirements of a government entity can be precisely met without waiting for vendor updates. In contrast, Socrata, while offering some level of customization, does not provide the same breadth of modifiability due to its closed-source nature, potentially leaving some needs unmet. ## Support for open data standards CKAN’s architecture not only facilitates customization but also supports a range of open data standards, crucial for ensuring compatibility and interoperability in data sharing. Specifically, CKAN has support for the [Data Catalog Vocabulary (DCAT)](https://linkdigital.com.au/news/2024/09/what-is-dcat-and-why-is-it-important-for-data-catalogs-and-open-data-portals/), allowing for seamless integration and publication of datasets in accordance with international best practices. This feature is particularly important in the US and the EU, where federal and state mandates require that public data be accessible and in standard formats to ensure transparency and facilitate reuse. CKAN’s ability to be tailored for specific data standards further empowers government entities to meet local and international publication requirements efficiently. ## Comparing key functionality The following table gives a high-level overview of key functionality across Socrata and CKAN. **Feature****Socrata****CKAN** **Focus**Socrata focuses on publishing and managing data and the development of data catalogues, all within the overall Socrata data platform, which is a closed and proprietary system. CKAN is powerful and sophisticated open source software widely adopted by governments, including in the US, to power open data portals, internal data management catalogues and metadata catalogues. **Vendor lock-in**Proprietary software that prevents users from accessing, modifying, or distributing the underlying source code. This leads to vendor lock-in and makes it challenging to customise or switch to alternative solutions.CKAN is free to use, modify and distribute. There is no vendor lock-in, making it accessible and cost effective. Users keep complete control of their data and metadata. **Customisable** It can be difficult and expensive to modify Socrata software to suit the client’s needs or integrate applications seamlessly with their existing systems.CKAN is highly customisable through a variety of open source extensions that vastly increase its basic functionality and integrate seamless with a user’s existing data and digital operations. **Support and maintenance** Users are completely dependent on Socrata to meet all their support and maintenance needs. In addition to any support provided by third-party vendors, users draw on global community of users and contributors. This community also helps to create a rich ecosystem of customisation extensions.**Usage** Socrata is used by large-scale companies and government bodies, mainly in the United States.Used in some of the many governments, including [United States open data portal](https://data.gov/), [the state of Illinois open data portal](https://data.illinois.gov/), [Oklahoma’s Open Data](http://data.ok.gov/) and the [city of Boston](https://www.boston.gov/).**Data publishing and management**Users can access and update their data and metadata within the framework created by Socrata software’s dataset. Integration with any data format or data source is possible, it seamlessly fits into existing data publishing and management workflows and integrate with existing as well as legacy systems.**Data platform**Socrata is designed to help users share and analyse data within its data management platform. Used to power data management involving public facing and internal data platforms for governments at all levels around the world.**API access**Has built-in SODA (Socrata) API allowing users to access and interact with data stored in Socrata’s system of datasets. Developers can use API to build applications, dashboards and other tools. CKAN’s API provides great functionality in terms of build applications, and developing portals, and tools to integrate with CKAN-powered data repositories, including complex integrations between systems. **Data Visualisation** Socrata offers data visualisation capabilities that enable users to create interactive charts, maps, graphs, and dashboards to explore and communicate insights from their data. Comes with a range of extensions for data visualisation designed to integrate seamlessly with user’s existing data tooling and present as part of an attractive, customised front-end experience. **Integration with other services**Socrata provides a RESTful API that enables developers to interact with all the data hosted on the Socrata platform.API enables users to access datasets and other services stored on CKAN data portals and catalogues. Includes a RESTful API allows developers to interact with all aspects of its open data platform**Metadata cataloguing** The Socrata metadata API is a standardised way for authenticated users to retrieve and modify asset-level metadata on all Socrata assets. CKAN comes with advanced metadata and cataloguing features to organise and structure internal data, supporting better data governance and discovery.**Data control** Has data control features to enable users to effectively manage data access, security, and privacy. Delivers enhanced security, including the ability to limit access to datasets by setting group and individual permissions and introducing data validation and audit trails that enable users to track change. **[Download the PDF version](https://linkdigital.com.au/wp-content/uploads/2024/05/Socrata-and-CKAN-a-comparison-of-key-features-PDF.pdf)** ## In closing As governments worldwide strive to enhance their digital services, choosing the right open data platform becomes critical. CKAN offers extensive benefits over proprietary systems like Socrata, including unmatched extensibility, avoidance of vendor lock-in, full data control, and the promotion of open source principles in public infrastructure. By opting for CKAN, government entities can not only meet their current data needs but also future-proof their digital infrastructure for emerging challenges and opportunities. For governments committed to transparency, efficiency, and citizen engagement, CKAN represents a robust, flexible, and cost-effective solution that aligns with the principles of open governance. Interested to hear more? [**Get in touch**](https://linkdigital.com.au/get-in-touch/) and one of our open data and CKAN experts will be in touch. --- *The world of open data and data management is constantly evolving. [Link Digital ](https://linkdigital.com.au/)provides insights to help you stay updated. **[Subscribe to our newsletter.](https://linkdigital.com.au/newsletter)*** **Categories:** All articles, CKAN, Government, Kate Sampher, Open Data, Technology Infrastructure, Thought Leadership, Topics **Tags:** CKAN, open data, Thought Leadership --- ### [CKAN 2.11 Migration: what you need to know](https://linkdigital.com.au/news/2024/10/ckan-2-11-migration-what-you-need-to-know/) **Published:** August 21, 2025 **Author:** Kate Sampher **Excerpt:** The CKAN 2.11 migration is a step toward improved, scalable, and efficient data management. Whether your organisation is already using CKAN or considering implementing it, integrating ckanext-files will enable you to manage documents more effectively, enhance user workflows, and ensure your data infrastructure is ready for the future.  **Content:** Latest update: April 13, 2026 *This blog post was co-authored by CKAN expert Sergey Motornyuk.* - [Why CKAN 2.11?](#aioseo-why-upgrade-to-ckan-2-11) - [The key benefits of adopting ckanext-files](#aioseo-the-key-benefits-of-adopting-ckanext-files) - [Download ebook: How to Install CKAN 2.11](#aioseo-download-ebook-how-to-install-ckan-2-11) - [Use cases](#aioseo-use-cases) - [Managing complex publishing workflows](#aioseo-managing-complex-publishing-workflows) - [Enhanced data quality requests](#aioseo-enhanced-data-quality-requests) - [File thumbnails and previews](#aioseo-file-thumbnails-and-previews) - [Streamlining data sharing across portals](#aioseo-streamlining-data-sharing-across-portals) - [Ingesting CSV/XLSX/ZIP Files](#aioseo-ingesting-csv-xlsx-zip-files) - [Future-proofing with CKAN 2.11 and ckanext-files](#aioseo-future-proofing-with-ckan-2-11-and-ckanext-files) - [Need help to migrate to CKAN 2.11?](#aioseo-need-help-to-migrate-to-ckan-2-11) For organisations already using CKAN, this migration offers improvements in file management, resource handling, and overall performance. If you haven’t yet integrated *ckanext-files*, CKAN 2.11 provides a starting point to adopt it for better file storage, discoverability, and workflow flexibility. Here are the reasons why CKAN 2.11, alongside *ckanext-files*, is a critical upgrade and how different projects have successfully implemented this transition. ## **Why CKAN 2.11?** CKAN 2.11 offers a range of enhancements that make managing data more efficient and effective, especially for organisations with complex data workflows. The upgrade allows for better file handling, more secure data exchanges, and smoother integration with existing systems. Migrating ensures compatibility with the latest extensions and improves the performance of large datasets. In particular, ***ckanext-files*** is a critical extension that enhances file management, enabling users to upload, organise, and manage files with greater flexibility and control. It’s important to note that СKAN 2.11 introduces compatibility with Python versions 3.9 to 3.12. With Python v3.11, users could see a potential 10%–60% increase in code execution speed (as detailed in the [release notes](https://docs.python.org/3/whatsnew/3.11.html#summary-release-highlights)). Although this doesn’t guarantee that your application will run faster, it’s a possibility worth considering. ## **The key benefits of adopting ckanext-files** With the integration of *ckanext-files*, CKAN 2.11 allows for file management. This extension enables you to: - Maintain comprehensive metadata and access control, ensuring files remain secure and traceable. - Improve the discoverability of raw and processed data through structured file indexing. - Improve workflows for managing files across various stages of data publishing. - Handle multiple file types and large datasets with ease. --- [![Publish your data easily with CKAN](https://linkdigital.com.au/wp-content/uploads/2024/10/final-img-publish-your-data-easily-with-CKAN-1024x535.jpg)](https://linkdigital.com.au/move-to-ckan/)***Migrating from your legacy data management system?*** [***Move to CKAN***](https://linkdigital.com.au/services/move-to-ckan/) --- ## Download ebook: How to Install CKAN 2.11 [ebook\_How to Install CKAN 2.11\_compressed](https://linkdigital.com.au/wp-content/uploads/2024/10/ebook_How-to-Install-CKAN-2.11_compressed.pdf)[Download](https://linkdigital.com.au/wp-content/uploads/2024/10/ebook_How-to-Install-CKAN-2.11_compressed.pdf) ## **Use cases** ### *Managing complex publishing workflows* In some projects, datasets go through multiple stages of publishing, with temporal files produced on different publishing stages. With the potential upgrade to CKAN 2.11, the newer version of the *file extension* would maintain this core functionality while introducing opportunities for smoother workflows and better integration. ### *Enhanced data quality requests* Another implementation involves handling multiple types of requests, including those aimed at improving data quality. Users submit categorized research data that is reviewed and used to enhance or create new datasets. The flexibility of the *file extension* supports these diverse workflows, and with CKAN 2.11, there’s the potential to introduce further improvements to file management and data quality workflows. This includes providing access to the source data used for assembling the resource or exposing multiple resource’s attachments in different formats, provided in advance. ### *File thumbnails and previews* In some use cases, thumbnails are generated for uploaded files, providing a visual preview similar to book covers. By utilizing the file extension, these thumbnails can either be automatically generated or provided manually. With CKAN 2.11, API improvements would allow for easier integration, enabling the creation of thumbnails at the time of resource creation with minimal configuration changes. ### *Streamlining data sharing across portals* Certain projects involve managing large datasets across multiple sub-portals. In the past, duplicating data across portals was slow and costly. The files extension now allows for the use of shared cloud storage, where the main portal generates download links based on the appropriate storage configurations. Migrating to CKAN 2.11 could further streamline this process, offering better integration with cloud storage solutions and reducing data duplication costs. ### *Ingesting CSV/XLSX/ZIP Files* For portals that handle file ingestion in formats like CSV, XLSX, and ZIP, the files extension retains source files, allowing for re-ingestion and archival of older data. This ensures traceability and long-term accessibility of datasets. With CKAN 2.11, the possibility to optimize storage solutions further, such as moving older files to lower-cost storage while maintaining accessibility, presents a significant efficiency gain for these portals. ## **Future-proofing with CKAN 2.11 and *ckanext-files*** Upgrading to CKAN 2.11 with the file extension prepares your organisation for future workflow changes. Upcoming features will include various UI widgets for different scenarios of file uploads and high-level features. This includes: the ability to pause the upload; to upload the file while the user is still filling in the rest of the form fields, making the UI more responsive; and previewing the file upon selection. ## **In summary** The CKAN 2.11 migration is a step toward improved, scalable, and efficient data management. Whether your organisation is already using CKAN or considering implementing it, integrating *ckanext-files* will enable you to manage documents more effectively, enhance user workflows, and ensure your data infrastructure is ready for the future. ## **Need help to migrate to CKAN 2.11?** Your upgrade shouldn’t be a hassle. But if you need help, [Link Digital](https://linkdigital.com.au/) CKAN experts have guided numerous organisations through the migration process. [Get in touch with Link Digital CKAN experts](https://linkdigital.com.au/get-in-touch/) **Categories:** All articles, CKAN, Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Industry, Internal data hub, Kate Sampher, Open Data, Smart City, Thought Leadership, Tutorial **Tags:** CKAN, data portal, migration, open data, Thought Leadership --- ### [How CKAN and FAIR Principles can enhance metadata management](https://linkdigital.com.au/news/2024/08/how-ckan-and-fair-principles-can-enhance-metadata-management/) **Published:** August 4, 2025 **Author:** Andrew Nette **Excerpt:** How a CKAN metadata catalogue can help your research organisation better manage its data and align with the FAIR Principles. Read more. **Content:** As a data manager in a large research organisation, you face many challenges. Not only do you have to manage a seemingly ever-expanding amount of data. You are responsible for overseeing data quality and how to enable the finding and sharing of data quickly and securely internally, externally, or both, across its life cycle. Whatever your organisation’s data focus, effective metadata management will be critical. Link Digital develops metadata catalogues using CKAN – the Comprehensive Knowledge Archive Network – a leading open-source data management platform. These use metadata to organise and structure your internal data, supporting better data governance and discovery. A [metadata catalogue](https://linkdigital.com.au/secure-data-exchange/#:~:text=Metadata,between%20data%20catalogs.) can also align your research organisation with the globally recognised FAIR Principles. Let’s look in more detail at how a CKAN metadata catalogue can help your research organisation better manage its data. ## **The importance of metadata management** Metadata is meaningful and useful data about your data, i.e., its origins, history, location, ownership and versions. It plays a vital role by offering additional information about a dataset that informs users of the data’s content and context. In many respects, it is the thread that helps data stewards create a comprehensive and coherent picture of their organisation’s data assets. Metadata is vital to enabling organisations to organise and extract insights and value from data, to inform research, policy analysis and decision making. In turn, metadata can help reduce the time researchers spend searching for data or, in the worst case, recreating data assets that already exist but lack internal visibility. In addition, metadata is important in assisting research organisations to comply with legal and regulatory requirements, particularly relating to personal or sensitive data. Metadata also plays a crucial important role in bringing research organisations into alignment with the FAIR principles. First articulated in [a 2016 article in the open access journal, *Scientific Data*](https://www.nature.com/articles/sdata201618)[,](https://www.nature.com/articles/sdata201618) the FAIR Principles are Findability, Accessibility, Interoperability, and Reuse of digital data. These principles have gained considerable traction amongst the international research community and adherence to them is now widely seen as a best practice in terms of data management. ## **How can a CKAN metadata catalogue help?** Metadata catalogues – essentially an organised collection of details that describe the various data assets within an organisation – are becoming a core component of modern data management infrastructure. They give research organisations the ability to develop a centralised and comprehensive index of data assets that goes beyond the basic collection and storage needs of their primary use cases. [CKAN has wide ranging functionality in relation to metadata catalogues](https://ckan.org/features/metadata). This includes searching datasets by any metadata field, data previews for different formats, extra fields for additional information, and the ability to track changes to metadata and view whether a dataset is available under an open licence and, if not, who it is owned by. In reference to the FAIR Principles, a CKAN metadata catalogue offers the following: ### ***Findability*** Rich metadata improves the findability and sharing of data, both across different platforms and domains, as well as within an open data portal or an internal data management platform, by enabling users to search for and discover data assets based on various criteria, such as keywords and tags. Users can customise metadata to capture subject and organisational level vocabulary, to a very detailed level. In addition, CKAN provides a powerful API for close integration with other systems, as well as support for common metadata standards like DCAT. ### ***Accessibility*** Data stewards can set permission settings to manage who can view, edit or use the metadata and associated data sets. This enables data to be shared in a highly secure and controlled access environment. Accessibility is also strengthened through the ability to make metadata openly accessible even if the dataset attached to it has access restrictions. The creation of a streamlined approval procedure for data sharing improves transparency and enables data stewards to discern and report on data usage patterns over time and across different levels and functionalities of an organisation. The other unique aspect of CKAN is that being open source, it can be customised without restriction to allow data access to be tailored very specifically and appropriately to whatever ‘better’ access means for an organisation, without any compromise to its core value in the area of machine access. ### ***Interoperability*** Detailed and consistent metadata is a key component of machine actionability – the capacity of computers to locate, access, interoperate, and reuse data with none or minimal human intervention. This includes the ability to connect with various data sources and systems to automatically ingest or update data across different systems and platforms, including legacy systems. CKAN supports all the key metadata standards for consistent description and features such as customised metadata templates save time and provide consistent metadata descriptions. ### ***Reusability*** Rich metadata, including detailed information about the content, context and ownership of each dataset, makes it easier for researchers to find and reuse data. It also helps to ensure that reuse is carried out properly and adheres to any necessary regulatory and legal frameworks, including data usage rights and licensing. This not only saves time but builds confidence in the quality and relevance of your data, facilitating greater data use, reuse and collaboration. And because CKAN is open source, there is no vendor lock in and no licensing fees. Instead, the costs are associated with hosting and customisation by a third-party service provider. This makes it more accessible and cost effective. No vendor lock-in also means that users keep complete control of their data and metadata. ## **Case study: Canadian Watershed Information Network** Managed by [University of Manitoba’s](https://umanitoba.ca/) [Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/), the Canadian Watershed Information Network (CanWIN) is an internal data management platform that collects and manages a large array of climate data and shares it with researchers. Link Digital developed a detailed metadata catalogue for the site as part of an overhaul of it in 2020. This has enabled researchers to undertake far finer grained exploration of datasets and tell far more complex stories about the data used in their work. The changes have also powered greater collaboration and enabled researchers to better collate and access data for analysis from a hyperlocal to global scale. According to Claire Herbert, CanWIN Head of Digital Strategy, it has also created ‘a more reproducible data as all details of data collection and analysis can be recorded, and creates a more collaborative, open environment.’ [Read more about CanWin case study](https://linkdigital.com.au/case-studies/canadian-watershed-information-network-canwin/). --- ## Enhance your data management with Link Digital Do you want to improve your research organisation’s metadata management and better align with the FAIR principles? If so, [contact Link Digital](https://linkdigital.com.au/get-in-touch/) and one of the data experts will be in touch. **Categories:** All articles, CKAN, DCAT (Data Catalog Vocabulary), Environmental/Climate Change, Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Internal data hub, Non-profit/NGO, Open Data, Smart City **Tags:** CKAN, FAIR Principles, internal data management, metadata, open data --- ### [Link Digital’s Lead Developer officially joins CKAN technical team](https://linkdigital.com.au/news/2017/05/link-digitals-lead-developer-officially-joins-ckan-technical-team/) **Published:** May 23, 2017 **Author:** Steven De Costa **Content:** We are delighted to announce that our Lead Python/CKAN Developer [Sergey Motornyuk](https://www.linkedin.com/in/sergey-motornyuk-a33226108/) has officially joined the CKAN technical team. Sergey’s CKAN journey started in 2014 when he joined Link Digital’s development team based in Ukraine. Since that time, Sergey has contributed over 590 commits to [CKAN ](https://github.com/ckan/ckan)Core, [CKAN Extensions](https://github.com/ckan/ckan/wiki/List-of-extensions) and various [DataShades](https://github.com/DataShades) repositories on GitHub. ## **What does the CKAN technical team do?** The technical team are the “official committers” for the CKAN software. The team has a number of responsibilities such as technical documentation, releases, QA, managing code contributions, organising Dev meetups, and many more. ## **What does this change mean to Link Digital?** Most of Link Digital’s clients are government agencies willing to share their data with the community through the use of open source software, specifically CKAN. CKAN technical team membership, as well as a [CKAN Association Steering group membership](https://linkdigital.com.au/about-us/), is a great opportunity for [Link Digital ](https://linkdigital.com.au/)to facilitate the development of the CKAN project whilst taking into consideration the needs and interests of [our customers](https://linkdigital.com.au/ourclients). To learn more about CKAN Technical Team visit: **Categories:** All articles, CKAN, Open Data, Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** Thought Leadership --- ### [Link Digital’s contribution to Croissant 1.1 expands AI research’s global reach with multilingual metadata](https://linkdigital.com.au/news/2026/02/link-digitals-contribution-to-croissant-1-1-expands-ai-researchs-global-reach-with-multilingual-metadata/) **Published:** February 9, 2026 **Author:** Kate Sampher **Excerpt:** Link Digital’s senior solutions architect, Ian Ward, contributed the MLCommons implementation of Croissant's multilingual metadata support. **Content:** The release of Croissant 1.1 (in coordination with [MLCommons](https://mlcommons.org/)) represents an important milestone in making datasets more accessible and interoperable worldwide. At the core of this update is a major feature by **Link Digital’s senior solutions architect,** [**Ian Ward**](https://www.linkedin.com/in/ianward/?originalSubdomain=ca&skipRedirect=true&originalSubdomain=ca), who contributed to the implementation of **multilingual metadata support**. ## **How CKAN and Croissant 1.1 improve data set metadata** Croissant is a new high-level metadata format for machine learning datasets designed to make datasets easier to discover, use, share, and integrate with machine learning tools and platforms. Ward’s contribution aligns Croissant’s metadata structure with the standards used in [CKAN](http://linkdigital.com.au/ckan/), specifically the [ckanext-fluent](https://github.com/ckan/ckanext-fluent) and [ckanext-scheming](https://github.com/ckan/ckanext-scheming) approaches that he has long championed. By enabling datasets to hold labels and descriptions in multiple languages simultaneously, this update ensures that global data portals can ‘speak the same language,’ making AI research more inclusive and accessible worldwide. ![Croissant metadata - an illustration by Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/02/2-Croissant-1.1-multilingual-metadata-1024x535.webp)*An illustration of how Croissant’s metadata works* ## **Why Croissant matters for the global community** In the past, much of the world’s most powerful AI was built using data labeled primarily in English, creating a ‘digital language gap.’ By making it easy for datasets to be described in any language, Ian and the [Link Digital ](https://linkdigital.com.au/)team are helping to democratize AI. Our work is helping researchers in non-English-speaking regions to find, understand, and use high-quality data more effectively, ensuring that the benefits of artificial intelligence are shared by everyone, regardless of what language they speak. ## Ongoing work Beyond this milestone, Ian has been a key voice in shaping the future of the ML data standard. His ongoing work and discussions regarding **composite foreign key support** (which allows the linking of multiple fields together to define a unique relationship between different tables or files within a dataset) and **data validation** (a capability through its Python library – **[mlcroissant](https://pypi.org/project/mlcroissant/)**– and visual editor, ensuring the metadata and the underlying data adhere to defined structures).Both pieces of work are already paving the way for the next release, further solidifying Croissant as the premier format for high-quality, reproducible machine learning datasets. You can read more about [Croissant here ](https://mlcommons.org/working-groups/data/croissant/)or visit its [GitHub repository](https://github.com/mlcommons/croissant). **Categories:** All articles --- ### [What is digital public infrastructure and can it help reverse the decline in public trust in government?](https://linkdigital.com.au/news/2025/10/what-is-digital-public-infrastructure-and-can-it-help-reverse-the-decline-in-public-trust-in-government/) **Published:** October 23, 2025 **Author:** Andrew Nette **Content:** *The following is the first of a series of articles on the [Open Government Partnership Summit 2025](https://www.opengovpartnership.org/events/2025-ogp-global-summit/), in Vitoria-Gasteiz, Spain, in early October. [Link Digital ](https://linkdigital.com.au/)Senior Solutions Architect [Adrià Mercader](https://www.linkedin.com/in/adriamercader/) and Technical Writer/Analyst [Andrew Nette](https://www.linkedin.com/in/andrew-nette-9780a4266/?miniProfileUrn=urn%253Ali%253Afs_miniProfile%253AACoAAEEnKmwBauWuHRdrdS8uNElh2NnYzIh3tVU&skipRedirect=true&miniProfileUrn=urn%3Ali%3Afs_miniProfile%3AACoAAEEnKmwBauWuHRdrdS8uNElh2NnYzIh3tVU)* attended the event. ![What is digital public infrastructure and can it help reverse the decline in public trust in government?](https://linkdigital.com.au/wp-content/uploads/2025/10/Photo-OGP2025-Andrew-Adria-2.png)Technical Writer/Analyst [Andrew Nette](https://www.linkedin.com/in/andrew-nette-9780a4266/?miniProfileUrn=urn%253Ali%253Afs_miniProfile%253AACoAAEEnKmwBauWuHRdrdS8uNElh2NnYzIh3tVU&skipRedirect=true&miniProfileUrn=urn%3Ali%3Afs_miniProfile%3AACoAAEEnKmwBauWuHRdrdS8uNElh2NnYzIh3tVU) (left); Senior Solutions Architect [Adrià Mercader](https://www.linkedin.com/in/adriamercader/) (right) One of the key topics at the [Open Government Partnership Summit 2025](https://www.opengovpartnership.org/events/2025-ogp-global-summit/) was, what is digital public infrastructure (DPI) and can it play a role in reversing the erosion of trust between citizens and their governments? Launched in 2011, the [Open Government Partnership](https://www.opengovpartnership.org/) (OGP) is a global initiative to promote transparency, accountability and citizen participation in governance, as well as providing an international forum for governments and civil society to cooperate on changes to empower citizens. The 2025 Summit brought together more than 2000 participants to discuss a range of issues, including what was generally agreed to be the gradual fragmentation in the social contract between people and their governments. Governments at all levels that attended the OGP Summit are feeling the pressures from this trend. This is where DPI could come into play. The digitisation of government services was seen by many of those present at the Summit as a potential way of heading off the erosion of citizen trust in official institutions, by enabling better and more citizen focused services. The following article will examine DPI and some of the key conversations that took place around it. ## The global state of digital public infrastructure DPI refers to core digital systems that enable governments to function better and ensure that citizens, organisations and government entities can interact, exchange information and access services securely and easily. [A report from the London based Institute for Innovation and Public Purpose](https://dpimap.org/) (IIPP), presented at the OGP Summit, has mapped the global uptake of DPI initiatives. *The DPI Mapping Project* aims to advance understanding of the state of DPI around the world by developing a baseline dataset on DPI initiatives and highlighting best practices around their development. Undertaking a high-level scan of 210 countries, the mapping project identified three key areas in which DPI is being implemented: - Digital identity systems: allow individuals to verify their identity once to access a range of government services, such as social welfare payments, healthcare, and education, etc. - Digital payment systems: platforms that have a public interest operator that can facilitate real-time financial transactions. - Data Exchange systems: digital systems that share data across sectoral/national levels, including ‘facilitating data sharing within government departments, to systems connecting multiple agencies and authorised third parties to share data crucial to public service delivery.’ According to [Krisstina Rao](https://www.linkedin.com/in/krisstina-rao/?originalSubdomain=de&skipRedirect=true&originalSubdomain=de), who presented the report on behalf of IIPP at the Summit, while there is still debate about what exactly DPI is, one clear finding that emerges from the research is that DPI “is more than about tech, it is also about good governance.” This means that DPI must be not only grounded in the operations of the state but include digital infrastructure that uses quality open data and that is transparent and inclusive. ## The vital role of trust in implementing digital public infrastructure Government representatives present at the OGP were bullish about the potential for DPI to reverse declining public dissatisfaction in government. This is because these digital interventions can directly improve the lives of citizens by solving key problems they face – such as providing a simplified one step form of digital identification to access government services. But there are major problems in the way of successful DPI implementation. In the past, “governments tried to develop digital infrastructure in a siloed way,” said Rao. “Each individual government department or agency had its own solution, which they have implemented themselves, using a different tech stack and authentication procedures.” The shift from a siloed to a collaborative approach that implements solutions that are interoperable across government is a key feature of DPI. As part of their DPI, many governments are pursuing multi-stakeholder approaches, which involve civil society and the private sector. But this collaboration can be difficult, particularly when DPI initiatives attempt to involve non-government stakeholders with different perspectives. One factor is different levels of digital interest on the part of the population, perhaps due to low levels of digital literacy and/or poor access to digital technology at the household level. Another factor that can negatively impact the design and rollout of DPI is low levels of trust in government. As one civil society representative put it: “In implementing DPI, is the government just asking the people for their information, i.e., biometric data or are we asking civil society for deeper input, for example, into the project design? DPI can work best when it is the latter track that governments go down.” [Yulita Mitei](https://nandi.go.ke/team/dr-yulita-chebotip-cheruiyot/), deputy governor of the Kenyan state of Nandi, argued that public participation is crucial for the development of DPI platforms. Mitei discussed the recent roll out of a digital portal to manage all government procurement in Kenya, the design and roll out of which was significantly improved by the involvement of local civil society groups. “Public participation is crucial for the effective development of DPI platforms.” ## Digital public infrastructure: the technology is far from neutral Another major debate is around the choice of technology. While many OGP representatives were hopeful about DPI’s ability to open up government, [Open Knowledge Foundation](https://okfn.org/en/) CEO [Renata Ávila](https://www.linkedin.com/in/renatavila/?originalSubdomain=fr&skipRedirect=true&originalSubdomain=fr) asked what role these initiatives can really play when so many of them utilise a stack built on software from a handful of big corporate tech players. “The fact is that a handful of big tech companies own over half of our digital backbone infrastructure \[globally\]. These players are not accountable and can easily shut down DPI developed by states with no consultation.” Echoing other civil society representatives present at the OGP, she urged governments implementing DPI initiatives to take a slow and steady approach with the tech that they use and test things out, especially in sensitive areas. While acknowledging these concerns, [Eurico Monteiro, Minister of State for Modernisation and Public Administration in the small West African state of Cabo Verde](https://www.africa-press.net/cape-verde/all-news/minister-of-state-modernization-and-public-administration-people-have-the-right-to-know-what-the-public-administration-is-doing), stated that the slow and steady approach is not always possible for smaller, poorer countries, already under pressure from their citizens to rapidly digitise services. “It is too slow and expensive,” he said. “Poor countries can’t replicate tech and have to use existing tools and tech platforms. We will take advantage of it with the understanding that we don’t know what is to come, hoping we can manage it.” But civil society and some government representatives maintained that governments don’t always have to start from scratch in terms of the tech they use in their DPI. Ávila made a strong pitch for the importance of open source technology such as CKAN – the [Comprehensive Knowledge Archive Network](https://ckan.org/) – which can be configured as a key component of DPI initiatives. Launched in 2006, CKAN has been widely adopted by governments across the world and can provide a sustainable digital public good and digital infrastructure. For example, CKAN serves as the key component of some of the largest and most successful open data portals around the world. These include [GovData](https://www.govdata.de/), the German Government’s open data portal, [the United States Open Data Portal](https://data.gov/), [Open Africa](https://africaopendata.org/), the largest repository of data on the African continent, and [Canada.ca](https://www.canada.ca/en.html), the official website of the Canadian Government. “CKAN can provide an affordable, stable, secure software solution for DPI initiatives, particularly in a context where the government has limited funds at its disposal,” noted Ávila. “It is fully interoperable, meaning it powers collective libraries that talk to each other and CKAN’s links to the open data movement and the role that citizens play in this, are closely aligned to the OGP’s aims and objectives.” “Public data infrastructure should be designed for resilience and long term sustainability, which might mean using sustainable technology,” said another OGP participant, referring to the need for mature, community-driven open source technology with a proven track record. “This is particularly important when we factor in infrastructure maintenance. Because it is not just a matter of building DPIs but maintaining them in the long term.” ***Also read: [Government Open Data Portals: a look at CKAN and Socrata](https://linkdigital.com.au/news/2024/05/government-open-data-portals-a-look-at-ckan-and-socrata/)*** **Categories:** All articles, CKAN, Digital Public Infrastructure, Government, Open Data **Tags:** CKAN, Digital public infrastructure, Open Government Partnership, Open Government Partnership Summit 2025, Open source technology --- ### [Expanding the reach and building connections: lessons from the CKAN project](https://linkdigital.com.au/news/2024/11/expanding-the-reach-and-building-connections-lessons-from-the-ckan-project/) **Published:** November 27, 2024 **Author:** Andrew Nette **Excerpt:** Read about CKAN's governance structure. The following post recaps Adrià’s presentation at the CLARIN event and explores some of the issues arising from it. **Content:** ***This blog post was co-authored by* *[Adrià Mercader](https://www.linkedin.com/in/adriamercader/?originalSubdomain=es "Adrià Mercader"), Senior Solutions Architect at Link Digital*** **Go to a specific topic:** - [CKAN's growing user base](#aioseo-ckans-growing-user-base) - [CKAN's governance structure](#aioseo-ckans-governance-structure) - [Benefits and challenges of private sector involvement in CKAN](#aioseo-benefits-and-challenges-of-private-sector-involvement-in-ckan) - [Conclusion: the importance of diversity](#aioseo-conclusion-the-importance-of-diversity) - [Want to build a CKAN-based portal?](#aioseo-want-to-build-a-ckan-based-portal) The data management system known as CKAN ([the Comprehensive ](https://ckan.org/)[Knowledge](https://ckan.org/)[ Archive Network](https://ckan.org/)) was originally developed as an open source open data catalogue for publishing data online. While governments at all levels where its early adopters and continue to be a major component of its user base, CKAN’s uptake has gradually extended to domains, including the not-for-profit and private sectors. During a [panel presentation at the recent annual conference of CLARIN (](https://www.clarin.eu/event/2024/building-bridges-industry-clarin2024)[Common Language Resources and Technology Infrastructure](https://www.clarin.eu/event/2024/building-bridges-industry-clarin2024)), a network of mostly European research centres specialising in language research to support humanities and social science, Link Digital’s Spain-based Senior Solutions Architect, Adrià Mercader*,* discussed the challenges and lessons of building bridges between CKAN and the private sector. The following post recaps Adrià’s presentation and explores some of the issues arising from it. ## **CKAN’s growing user base** CKAN was originally designed to be very customisable and adaptable, so as to be easy to integrate it with other systems. It is open source, not just in the sense that the code is public and available online, but in that it is maintained by a large and growing community of stakeholders. These organizations and individuals include a mix of representatives and contributors from the not-for-profit, academic, and government sectors, as well as commercial vendors and industry members. The growing role of CKAN in the digital ecosystem is evidenced by the fact that it serves as the key component of some of the largest and most successful open data portals around the world. [Research in 2023 identified nearly 400 regularly updated CKAN data portals of different sizes in 59 countries](https://civicdataecosystem.org/2023/06/19/analysis.html). These are spread across six major continents, with Brazil and the United States having the largest prevalence, followed by Argentina, Australia, Canada, Germany, the UK, Spain, Italy, and Japan. They include globally significant portals such as [the EU’s open data portal](https://data.europa.eu/en), the [United States open data portal](https://data.gov/), and [Open Africa](https://africaopendata.org/), the largest repository of data on the African continent, but also many smaller scale users with limited resources or technological expertise at their disposal. And while governments remain a major part of CKAN’s reach, the software’s user base has grown and diversified. CKAN is currently used by multilateral organisations like the [UN Refugee Agency](https://www.unhcr.org/) and the [United Nations Office for the Coordination of Humanitarian Affairs](https://www.unocha.org/), as well as not-for-profit organizations and grassroots civil society movements. And it has been steadily adopted in academic and research circles to organise and publish data in a wide range of subject areas. While it is hard to quantify exactly how much of CKAN’s total user base comes from the private sector, all the indications are that the software is being adopted more and more by the private sector, in areas ranging from pharmaceuticals and real estate to energy management. While it is harder to cite public URLs for this activity because these projects tend to be internal catalogues for private data, we know that many of the developers involved in the CKAN community are affiliated with the private sector, including commercial vendors such as Link Digital. Link Digital has worked on CKAN projects for [Suncorp](https://www.suncorpbank.com.au/), [Wesfarmers](https://www.wesfarmers.com.au/) and [Lego Global](https://www.lego.com/en-us/aboutus/lego-group), and has helped many other private sector organisations validate and select CKAN based applications for their work. ## **CKAN’s governance structure** CKAN was developed by the [Open Knowledge Foundation](https://okfn.org/en/) (OKF) in 2006, with the guiding principle that open data is a public good that should be non-right restricted and easily transferable, and that creates more value the more it is shared. And, initially, all the project development and management were done at OKF. There were some early high-profile sites that adopted CKAN, such as the [United Kingdom open data portal](https://www.data.gov.uk/), but a significant surge in sites adopting CKAN did not occur until the second decade of the 2000s. It was at this point that OKF decided to set up the CKAN project in a way that would allow other stakeholders to contribute and, more importantly, to have a say in its direction. This decision was taken out of a desire to open the project’s governance to other parties and the more practical need to ensure its sustainability by welcoming contributions from outside OKF. CKAN’s governance structure has evolved over the years, and currently comprises three levels: - OKF as the custodian of assets like the trademark and domains, etc. - A tech team that maintains CKAN’s code base and handles contributions from the community. - Project co-stewards – one of which is [Link Digital – that help set strategy and fundraising, goals, etc.](https://linkdigital.com.au/news/2024/05/link-digitals-major-initiative-to-boost-ckan-development/) ## **Benefits and challenges of private sector involvement in CKAN** With this background in mind, it is instructive to have a closer look at the role that the private sector plays in the CKAN ecosystem today. First and foremost, if we are talking about the actual number and volume of contributions to CKAN, a big part of them come from private sector-funded individuals. That’s anything from occasional patches and features sent by developers working on commercial projects to people funded to work full-time on the maintenance of CKAN. A major proportion of the CKAN tech team are in some way linked to private sector vendors, and both CKAN co-stewards are from the private sector. And while much of the private sector’s growing adoption of CKAN doesn’t directly translate into tangible project contributions, it brings wider benefits. It increases the private sector’s exposure to CKAN and open source technology more generally and injects novel points of view, scenarios, technologies, and development practices into the project that help it grow and explore new areas. Seen from this perspective, the private sector plays a major role in the CKAN ecosystem. While this is in most cases positive, it does come with challenges and risks that need to be monitored so that they don’t become issues. Private sector participants sometimes have needs and goals that may not be 100% aligned with those of the CKAN project, so it’s important to make sure that CKAN’s original goals in terms of intended audience and use cases, and the required level of skill to use the software, are maintained. Directly related to this, it is important that the novel points of view or practices mentioned previously don’t leave a section of the CKAN community behind, i.e., by increasing the onboarding period due to more complexity or increasing the out of the box costs of using software. Then there’s the more philosophical question relating to asymmetry in contributions. An issue faced by all open source projects, it is an especially important consideration for CKAN, a project which is based on the premise of democratising access to knowledge or data and, more broadly, to provide a benefit to society. Seen in this context, it is vital to always ask the question – what value is the private sector getting from the project? ## **Conclusion: the importance of diversity** There are three key take-aways in terms of building bridges between the private sector and open source software projects such as CKAN, and ensuring their sustainability: - If done properly, involving the private sector can bring a net benefit to the project. - It’s important to set up the project in ways that facilitate it to grow, including allowing external players to be involved, without creating friction. - We always need to ensure that the original goals and philosophy of the CKAN project are maintained The best way to ensure the success of linkages between CKAN and the private sector is to ensure a diverse community around CKAN, to ensure all sectors are represented. The more community, not-for-profit, research, and government interests are represented, the less likely it is that decisions that don’t benefit them are going to be taken. ## **Want to build a CKAN-based portal?** [Contact us](https://linkdigital.com.au/get-in-touch/) and one of our data experts will be in touch. - [LinkedIn](https://www.linkedin.com/company/link-digital) - [YouTube](https://www.youtube.com/@link-digital) **Categories:** All articles, CKAN, Government, Higher Education/Research **Tags:** CKAN, private sector --- ### [Enhancing DCAT support in CKAN (DCAT-AP v3, scheming integration, and more)](https://linkdigital.com.au/news/2024/10/enhancing-dcat-support-in-ckan-dcat-ap-v3-scheming-integration-and-more/) **Published:** October 25, 2024 **Author:** Kate Sampher **Excerpt:** This blog post originally appeared on ckan.org/blog and was authored by Link Digital senior solution architect, Adria Mercader. **Content:** *This blog post originally appeared on [ckan.org/blog](https://ckan.org/blog/ "ckan.org/blog") and was authored by Link Digital senior solution architect, [Adria Mercader.](https://ckan.org/blog/author/amercader)* March 26, 2026 - [Sharing metadata with DCAT](#aioseo-sharing-metadata-with-dcat) - [ckanext-dcat: a CKAN extension for DCAT](#aioseo-ckan-dcat-ckanext-dcat) - [So a CKAN dataset that looks like this in the CKAN API:](#aioseo-so-a-ckan-dataset-that-looks-like-this-in-the-ckan-api) - [Will look like this as a DCAT serialization:](#aioseo-will-look-like-this-as-a-dcat-serialization) - [What’s new on ckanext-dcat 2.0.0](#aioseo-whats-new-on-ckanext-dcat-2-0-0) - [What next?](#aioseo-what-next) - [Link Digital as your trusted CKAN and open data portal experts](#aioseo-link-digital-as-the-trusted-ckan-and-open-data-portal-experts) Long standing support for the DCAT standard in CKAN has been recently expanded with the release of ckanext-dcat v2.0.0, which includes support for DCAT-AP v3 and seamless integration with ckanext-scheming. We want to keep expanding the DCAT support in CKAN and are keen to hear from publishers and consumers to learn how you are using DCAT and what is missing. ## Sharing metadata with DCAT Data and metadata sharing is one of the key features of data portals. To be able to fulfill their role as data disseminators, portals need ways to share information about the datasets they host with other systems. Most data portals like CKAN will have some form of API that will enable programmatic access to discover and import metadata records but of course different systems will use different representation formats, API endpoints etc. To help provide a common vocabulary for sharing metadata across data portals, [DCAT](https://www.w3.org/TR/vocab-dcat-3/) was formalized as a W3C recommendation back in 2014, building on previous work performed in different institutions. The CKAN community has always been close to these discussions from an early point, with some initial efforts like [spec.dataportals.org](https://spec.dataportals.org/) dating back to 2012. DCAT provides a number of classes for different entities, like Catalogs, Datasets, and so on, and describes what properties should be included for each of them, as well as the relationships between them. On top of the DCAT recommendation, other profiles can be built. These can focus on specific regions or administrations like [DCAT-AP](https://semiceu.github.io/DCAT-AP/releases/3.0.0/) and [DCAT-US](https://doi-do.github.io/dcat-us/) for data portals in the European Union or the US respectively, or be domain specific like [GeoDCAT-AP](https://semiceu.github.io/GeoDCAT-AP) and [StatDCAT-AP](https://joinup.ec.europa.eu/collection/semic-support-centre/solution/statdcat-application-profile-data-portals-europe). ## ckanext-dcat: a CKAN extension for DCAT As DCAT grew in popularity and more organizations adopted it, work consolidated around [ckanext-dcat](https://docs.ckan.org/projects/ckanext-dcat/), a CKAN extension that helps data publishers expose and consume metadata serialized using DCAT. Ckanext-dcat is one of the most popular CKAN extensions, and it is used across major sites like the [German](https://www.govdata.de/), [Irish](https://data.gov.ie/) or [Swiss](https://opendata.swiss/en) national data portals. It allows to expose datasets created in CKAN in a semantic RDF format that is compliant with DCAT specifications. ### So a CKAN dataset that looks like this in the CKAN API: ``` { "id": "425e361b-bad9-4a8f-8cc4-2e147c4e8c18", "name": "my-ckan-dataset", "title": "An example CKAN dataset", "description": "Some notes about the data", "temporal_coverage": [ { "start": "2024-01-01", "end": "2024-12-31" } ], "resources": [ { "id": "df0fc449-fddf-41af-910a-f972b458956c", "name": "Some data in CSV format", "url": "http://my-ckan-site.org/dataset/425e361b-bad9-4a8f-8cc4-2e147c4e8c18/resource/df0fc449-fddf-41af-910a-f972b458956c/download/data.csv", "format": "CSV" } ] } ``` ### Will look like this as a DCAT serialization: ``` @prefix dcat: . @prefix dct: . @prefix xsd: . a dcat:Dataset ; dct:identifier "425e361b-bad9-4a8f-8cc4-2e147c4e8c18" ; dct:temporal [ a dct:PeriodOfTime ; dcat:endDate "2024-12-31"^^xsd:date ; dcat:startDate "2024-01-01"^^xsd:date ] ; dct:title "An example CKAN dataset" ; dcat:distribution . a dcat:Distribution ; dct:format "CSV" ; dct:title "Some data in CSV format" ; dcat:accessURL . ``` The extension works by allowing different [profiles](https://docs.ckan.org/projects/ckanext-dcat/en/latest/profiles/#profiles), providing built-in base profiles compatible with different versions of DCAT-AP, that can be adapted or expanded by site maintainers to support more targeted profiles. ## What’s new on ckanext-dcat 2.0.0 Having supported DCAT-AP version 2 for a while, the new [2.0.0 version of ckanext-dcat](https://docs.ckan.org/projects/ckanext-dcat/en/latest/changelog/#v200-2024-08-30) added support for the recently announced DCAT-AP version 3, allowing sites to update their DCAT support. More significantly, it also added support for integrating with the most common way to customize the CKAN metadata schema, [ckanext-scheming](https://github.com/ckan/ckanext-scheming). Ckanext-scheming allows to define different metadata schemas for a CKAN site using just configuration files, and will take care of handling the fields internally, validation, displaying the right template snippets in the UI, etc. Ckanext-dcat now integrates with ckanext-scheming, providing pre-built [schemas](https://docs.ckan.org/projects/ckanext-dcat/en/latest/getting-started/#schemas) that can be adapted by sites to provide out-of-the-box DCAT support. ## What next? We want to continue expanding the capabilities of ckanext-dcat to make it easier for publishers to provide their sites metadata - Provide support for [DCAT-US](https://doi-do.github.io/dcat-us/) as a built-in base profile - Improve the base profiles with support for codelists, multilingual properties, etc. - Explore support for other DCAT entities like [Dataset Series](https://www.w3.org/TR/vocab-dcat-3/#dataset-series). Some initial discussion can be found in this [issue](https://github.com/ckan/ckanext-dcat/issues/298) if you want to provide feedback or your potential use case. - Expand support to other application profiles like [DCAT-AP-HVD](https://semiceu.github.io/DCAT-AP/releases/2.2.0-hvd/) To do this and ensure that CKAN becomes the best metadata and data catalog for extensive DCAT support, we need your help! We need to hear from data publishers and consumers, from various jurisdictions on how you use DCAT, how your adoption of DCAT v3 is evolving, and how we can enable you with solid support in CKAN. ## Link Digital as the trusted CKAN and open data portal experts Link Digital has been actively participating in the CKAN community as co-stewards of the CKAN project. If you need assistance with your CKAN projects, [get in touch, and our team of experts will contact you. ](https://linkdigital.com.au/get-in-touch/) **Categories:** All articles, CKAN, DCAT (Data Catalog Vocabulary), Government, Higher Education/Research, Kate Sampher, Thought Leadership **Tags:** CKAN, Thought Leadership --- ### [From proprietary to open source: A New Zealand government agency's journey with CKAN](https://linkdigital.com.au/news/2026/03/from-proprietary-to-open-source-a-new-zealand-government-agencys-journey-with-ckan/) **Published:** March 24, 2026 **Author:** Andrew Nette **Content:** Switching digital infrastructure from proprietary to open source software is still seen by some as fraught with complexity. One organisation that has undertaken this process was the [Resources](https://www.mbie.govt.nz/building-and-energy/energy-and-natural-resources) [Markets Branch of New Zealand’s Ministry of Business, Innovation and Employment (MBIE)](https://www.mbie.govt.nz/building-and-energy/energy-and-natural-resources), when it replaced the proprietary software used to run its online data storage platform, with the open source [Comprehensive Knowledge Archive Network (CKAN)](https://ckan.org/). [Miles ](https://www.linkedin.com/in/milesdunkin/)[Dunkin](https://www.linkedin.com/in/milesdunkin/), MBIE’s Manager Geoscience and Geospatial, is responsible for the team that manages the stewardship and release of geospatial and geoscience exploration data and reports collected by permit holders and the New Zealand government. Dunkin contends that not only was the switch “relatively straightforward,” the benefits in terms of increased engagement with the new platform, especially on the part of non-expert users, as well as improved workflow and understanding on the part of his data team behind the scenes, have been substantial. I spoke to Dunkin recently about the challenges of his job at MBIE, what was involved in swapping from proprietary to open source, the benefits that have resulted from the shift, and what the plans might be for the MBIE’s data operations in the future. ## **One hundred and sixty years of data** The Resource Market’s Branch is responsible for the regulation and policy aspects related to the minerals and petroleum resources sector across New Zealand, including exploration for oil, gas, coal, gold, silver and many other minerals. This involves collecting, storing and managing huge amounts of data, including that gathered under mandatory industry reporting, and the sharing of this with the public. “There is a requirement, under the permits that we issue, for the operators to supply data back. That’s what I’m responsible for, the ingestion and the curation and then, at the appropriate time, the sharing back with the industry and the public the relevant information that has been supplied.” “There are a massive number of files and resources and data sets. Looking back, I think the oldest is 1866, so it is almost one hundred and sixty years of records. And then the other thing that is a challenge, because seismic is part of that, you get some very large datasets.” The work to replace the existing data setup was undertaken from 2020 to 2023. It involved the installation of two interconnected CKAN portals: an internal geoscience data asset register and a public-facing open data portal. The MBIE’s data team works day-to-day in the internal portal with all the private data, while the public one is literally just a public open data site. Three vendors were involved in the project, including Link Digital, which worked exclusively on the CKAN aspects of the project. This included CKAN customisation with the client’s internal data pipeline and workflow systems, data migration from legacy infrastructure to new CKAN instances, as well as providing ongoing support and maintenance. This included, most recently upgrading the set up to the latest version of CKAN. ![government open data portals](https://linkdigital.com.au/wp-content/uploads/2024/05/blog-img-government-open-data-portals-1024x1024.png)Also read: [Government opendata portals: a look at CKAN and Socrata](https://linkdigital.com.au/news/2024/05/government-open-data-portals-a-look-at-ckan-and-socrata/) ## **Using a sledgehammer to crack a nut** When it comes to the rationale for switching to open source, Dunkin is very clear. “Basically, we had a sledgehammer to crack a nut. We had industry specific software that was designed for the interchange across different government departments and organisations.” It was meant to be set up almost as a data mart, which meant giving people the ability “to trade and exchange data, as well as regulate what was going on. It was very comprehensive but also very proprietary and we were probably using a miniscule amount of it.” It was also “quite expensive”. “So, we looked around and thought, what can we do? because it was quite a complex set of architecture, not just a single piece of software.” The complexity and cost of the then existing proprietary software were not the only factors behind the decision, according to Dunkin. “Cloud storage was becoming a thing, rather than having to have your own tin sitting in a room somewhere on premise.” There was also strong desire to adopt open source technology solutions, in line with the New Zealand Government’s drive to improve the discovery and reuse of its open data, and support for the [FAIR principles](https://www.go-fair.org/fair-principles/) of Findability, Accessibility, Interoperability, and Reuse of digital data. “While we were looking around, one of the organisations that we thought we were quite closely aligned to, was [Geological Survey of Queensland (GSQ)](https://www.business.qld.gov.au/industries/mining-energy-water/resources/geoscience-information/gsq) and its [public facing geoscience open data portal](https://geoscience.data.qld.gov.au/). It seemed that they were doing something, a couple of years ahead of us, that was probably pretty similar to what we needed.” “And they kindly were very open and sharing with us what they developed. So, it was really the fact that they \[GSQ\] were ahead of us doing basically what we wanted to do and were willing to share that was a strong contributing factor and the fact that they were complimentary about Link Digital, which had been involved in the project.” ## **What do the interconnected portals do?** As noted earlier, the MBIE project consists of two interconnected portals, one public and the other private. **“**They’re effectively almost exactly the same. Under the Crown Minerals Act, which is the act that we regulate under, there’s a requirement to release information under certain conditions. The main condition is that after 5 years, the data becomes publicly available. That’s the main driver of the two portals. One is where we store everything and the commercial sensitive material that has not reached release date. The ingest of the material goes into the internal portal, anything new that comes in. And then the system is set up so that when it hits the 5 year date, it triggers my team to go and make sure that its appropriate for it to be released and then to release it into the public portal.” The release of data to the public portal happens semi-automatically. “There is always a human involved,” stresses Dunkin, to avoid the danger of inadvertent data release. “This was a key piece of the work with all the vendors, trying to figure out how all the backend pieces fit together, such that there was no way this could happen.” The MBIE used Jira to support the workflow related to the portals, which Link Digital configured and improved to integrate the CKAN instances with MBIE’s existing processes, so that they did not have to be implemented again from scratch. “So, CKAN lets Jira know when something is coming up, two weeks before its due for release, it builds a ticket into Jira and then we work in Jira to do all the checks and balances. And once that has happened and all that work has been completed, it makes the publish button available. It is hard wired into the system that the publish button will not be available until the appropriate date.” ![CKAN metadata catalogue](https://linkdigital.com.au/wp-content/uploads/2024/08/img-metadata_FAIR-1024x535.png)*Improved Findability* ## **Benefits of the new data set up** The main improvement that Dunkin has noticed with the transition to new data set up relates to [improved findability.](https://linkdigital.com.au/news/2024/08/how-ckan-and-fair-principles-can-enhance-metadata-management/#:~:text=offers%20the%20following%3A-,Findability,-Rich%20metadata%20improves) “We’ve noticed a big uptick in the number of people that have registered when we went from the old system to the new system. It’s clearly more user friendly from a public perspective. So, the requirement for \[improved\] findability has definitely been met.” This touches on a key concern of many data portal managers, how to get the data on their sites out to a larger group of stakeholders who aren’t data statisticians. “We know the experts can use it but how do you get it out to a larger group of people who are not data statisticians?” “You know with the gold price going gang busters in New Zealand we’re getting a lot of interest. And some of these people just have a Ute and a sluice, may struggle with technology. Even some midsize organisations, they still struggle a bit with the technology side of things. So, we’ve tried consciously to simplify things as much as possible and the CKAN interface is far simpler than the old one. So that’s been a help.” “In terms of the permit side of things, we’re breaking the previous year’s records of the number of permit applications. And I’m anticipating that that’s going to translate down the track when people start sending us reports and data back, to quite a big jump in the amount of material coming back to us. So, I think we’re in good shape before this hits.” But there have also been benefits in terms of how the MBIE data interacts with the portal. As Dunkin puts it: “We have more ability to understand what’s going on under the hood. You know, obviously we’ve got the vendors as the experts on this stuff, but it has improved the team’s knowledge of how the system works because it’s not proprietary. It’s not locked away. We’ve got a couple of people that really understand the workflow.” Dunkin also notes that the new CKAN system also makes his job as data manager easier. “The way it is set up and how CKAN has improved workflows, it is quite easy to manage the team workloads across the system. It is simple for \[the team\] to pick up each other’s work, so that you do not have one person sitting on a ticket and then that person goes on leave and the process stalls.” ## **Future plans** One thing flagged to improve in the very near future, is how to improve the download experience for people from the public portal. “When there is a break or an interrupt, a download just stops. So, you can be partway through downloading a terabyte of information and you could be on the last byte to come, and your download fails, you’ve got to start again. Improving that is our priority.” The other topic that is on the minds of MBIE’s data team is how they might use AI. “Those of us who use the system a lot have got quite good at finding what we want quickly and CKAN, with its search capabilities, certainly helps in that regard. But we’re thinking, wouldn’t it be great if we have some sort of functionality that allows us to say, ‘find me all the files that relate to X’.” “This is a challenge given the fact that the portals contain masses of unstructured data, everything from PDFs to who knows how many thousands of spreadsheets. That’s semi-structured data but there’s an awful lot of information there that would be super valuable but requires a large amount of effort to draw value from.” [Want to know more? Read the full case study of the MBIE data portal project on our site here.](https://linkdigital.com.au/case-studies/data-governance-geoscience-regulation-agency-leveraged-ckan/) --- ### Latest articles - [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) - [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) - [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) - [When the visitors aren’t human: What rising bot traffic means for your data portal](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) - [From open data to verifiable honesty: An experiment you can look at](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) **Categories:** All articles, Artificial Intelligence, CKAN, Digital Public Infrastructure, Geospatial, Government, Internal data hub **Tags:** Artificial intelligence, CKAN portal, geosciences --- ### [What is the future of open data in the AI era?](https://linkdigital.com.au/news/2026/03/what-is-the-future-of-open-data-in-the-ai-era/) **Published:** March 18, 2026 **Author:** Andrew Nette **Content:** What is the future of open data and CKAN – [the ](https://ckan.org/)[Comprehensive](https://ckan.org/)[ Knowledge Archive Network](https://ckan.org/) – given the rapid changes taking place in the open data ecosystem, in particular the rise of AI? This question was the focus of a seminar organised by the [Open Knowledge Foundation](https://okfn.org/en/) (OKF) to celebrate the recent [Open Data Day 2026](https://opendataday.org/) and the 20th anniversary of CKAN, which included presentations from Link Digital Executive Director [Steven De Costa](https://www.linkedin.com/in/stevendecosta?originalSubdomain=au) and Link Digital Full Stack Developer/CKAN expert [Oleksandr Cherniavsky](https://linkdigital.com.au/news/author/oleksandr-cherniavsky/). The open data movement and CKAN, a major component of the open source technology that supports it, face significant challenges and major opportunities. Core to both is making open data infrastructure more functional and relevant in the face of advances in machine learning, which is changing the terms of effective data management. The following article will look at some of the challenges and opportunities discussed in the OKF seminar. It will also touch on a new Link Digital capability presented during the event, that aims to addressing the gap between the large amount of data held on CKAN open data portals and the struggle many portal users have in locating the data they want and understanding it. ## **Different stages of the open data movement** For over two decades the open data movement – in which Link Digital has been an active participant – has been defined by the relatively straightforward philosophy and purpose of making data freely available to everyone to use and republic, without restrictions. The ‘First Wave’ of this movement was defined by volume: how many datasets can be released? The ‘Second Wave’ focused on the [FAIR principles (Findable, Accessible, Interoperable, and Reusable)](https://www.go-fair.org/fair-principles/). Central to the ‘Third Wave’, which came into play late in the 2010s, was the proposition that the open data ecosystem has moved beyond a focus on simplifying data and how it impacts our society and economy; to how data can better be systematised and how governments, private corporations and civil society organisations can better know and understand the data they have and share it to provide improved products and services, and a more informed citizenry. We are currently in the Fourth Wave, characterised by [The Gov Lab](https://thegovlab.org/) as the next frontier, ‘where open data is more conversational and AI ready, data quality and provenance are centre stage, a whole range of new use cases from open data are feasible and there are new avenues of data collaboration.’ ## **Adapting infrastructure for generative AI** The rise of generative AI and large language models (LLMs) means that making data open, while still crucial, is now no longer enough. Data now needs to be specifically structured to make it machine readable to AI agents that now crawl portals to LLMs and specialised analytical tools. Modern open data repositories are moving away from static files to architecture that supports vector search and real-time streaming, allowing AI agents to query data directly rather than downloading massive batches. And data provenance is increasingly vital, allowing creators to tag their work with ‘AI-usage’ permissions. ## **Threats facing the open data movement** Within this emerging framework, are threats and opportunities for the open data movement. The threats were discussed at length during the OKF event. These include the ability of AI to amplify bias, and the possibility of distortions and hallucinations, in part due to the internet becoming flooded with AI-generated content, which means models train on their own outputs until they become distorted and lose reality-grounding. Specifically related to the open data movement, there is also the fact that a large amount of open data is not AI ready. And if a portal’s data isn’t machine-actionable it risks becoming almost invisible. AI agents may skip your portal entirely. Or, worse, they may misinterpret key facts because the underlying data lacks the necessary structure and trust which, in turn, can have misrepresenting or damaging an organisation’s authority. ## **The opportunities in the AI era** One of the most significant opportunities comes from the fact that after years of scraping the public internet, AI developers have nearly exhausted the supply of high-quality, human-generated text. This has created an interesting tension: while more data is being produced than ever before, the *openly accessible* portion of high-quality training data is shrinking as platforms move behind paywalls to protect their assets from AI scrapers. This high quality verified open data from government and scientific institutions can thus be a ground truth, of sorts, that anchors that prevent AI models from drifting into hallucination. It is a positive development for the open data movement but taking advantage of it is not easy. As [Ruth Del Campo, General Director for Data at the Spanish Ministry for Digital Transformation and the Civil Service](https://www.linkedin.com/in/ruth-del-campo?originalSubdomain=es), put it in one of the panels in the OKF seminar: “How do we provide curated, trusted, open data resources for LLMs, in a way that creates efficiencies but does not exacerbate inequalities.” ## **What does this mean for data portals?** The current environment throws up many questions, but to focus on just one, what are the implications for one of the most common CKAN uses, open data portals? For the last two decades, the goals of data portal management have been relatively simple: ensuring efficient, reliable storage, and findability and shareability. Organisations built digital portals to act as repositories, which sometimes essentially functioned as passive digital filing cabinets where information was placed for safekeeping. AI is fundamentally shifting the goal posts, and the traditional open data portal, a static repository of CSV files, is no longer fit for purpose. There are many ways that portals will have to evolve to meet this, but a key one is having the most impactful data. For AI agents, this means making the data machine readable and findable. For the individual CKAN portal users, it means that a traditional search matching keywords in titles, descriptions, and other metadata fields, is not enough. It may work well when users know the exact phrasing used by publishers. But real-world users often search differently. Enabling users to undertake semantic search that is contextually informed is vital. ## **Introducing Link Digital’s Ask AI capabilities** Improved data discoverability is always going to be an ongoing challenge for open data portals. [Ask AI, a new CKAN extension](https://linkdigital.com.au/ask-ai/)[ by Link Digital](https://linkdigital.com.au/ask-ai/), seeks to deal with one aspect of it, that many users still struggle to locate the right dataset when they don’t know the exact terminology. They manually inspect metadata. They download files to understand the structure. In practice, access exists, but usability often lags far behind. Ask AI seeks to introduce an AI-powered layer on top of CKAN to address this gap between data discoverability and interpretation. ## **Ask AI search layer** It uses semantic similarity search. Instead of matching words, it matches meaning. Behind the scenes, dataset and resource metadata – along with supported document content – are converted into vector embeddings and stored in PostgreSQL using an extension called [pgvector](https://github.com/pgvector/pgvector). When a user performs a search, the system retrieves results based on semantic proximity rather than simple text overlap. The effect is broader recall without sacrificing relevance, discovery across inconsistent terminology, and reduced dependence on perfect metadata alignment. For organisations managing large portals, this materially improves dataset discoverability without requiring publishers to change workflows. It also means that not only is the data on CKAN-powered portals more findable and accessible, but users do not need to be a data scientist to understand their search results. ## **Ask AI’s security configuration** Importantly, in terms of data security, Ask AI can configure this in such a way that sensitive data remains within a secure infrastructure and proprietary information is never used to train public models like ChatGPT or Gemini. A data manager can define exactly which datasets the AI can access and who is authorised to query them. CKAN has made a vital contribution to making data open and shareable. Key to the next part of its journey will be how it can use AI to make the data on CKAN portals more accessible and understandable. “Knowledge is getting closer. It used to be that we had to go to a library, and you had to look stuff up, then you had to go to stack overflow and ask the right questions and search through a whole lot of stuff,” De Costa said during his presentation at the OKF seminar. “A lot of that searching and discovery is chaperoned into our hands quite easily.” What we need now is the ability to get a better understanding of the data we are asking for and what we get. “The future of data in an AI world is largely how we come to understand knowledge in our systems, in our civic systems, in our governance systems, in our commercial systems.” There are many aspects to this, including being much more mindful about how we create our data systems, improved data governance, data pipelines and the training of more appropriate LLMs, to name a few. But we are confident Ask AI can play a role in this effort. [You can read more about Ask AI in this short article on our website.](https://linkdigital.com.au/news/2026/03/ask-ai-link-digitals-ai-layer-for-smarter-ckan-portals/) Or sign up for a demo, and we can talk about your project and how Ask AI can improve your users’ interactions with data. [Get in touch to discuss how we can help](https://linkdigital.com.au/get-in-touch/). **Categories:** All articles, Artificial Intelligence, CKAN, Environmental/Climate Change, Government, Higher Education/Research, Non-profit/NGO, Open Data **Tags:** CKAN, open data and AI, open data movement, Open source technology --- ### [Making data portals user-friendly: a conversation with a UI/UX expert](https://linkdigital.com.au/news/2026/03/making-data-portals-user-friendly-a-conversation-with-a-ui-ux-expert/) **Published:** March 17, 2026 **Author:** Kate Sampher **Content:** Link Digital is lucky to have an excellent team member, Anastasiia Shevtsova, who works on the user interface/user experience (UI/UX) aspects of our data portal projects. I had a conversation with her to understand the importance of having a user-friendly data portal, especially for teams who don’t have a dedicated designer, and to share insights on best practices to improve portal usability through simple, actionable steps. ## **Who is Anastasiia Shevtsova as a UI/UX Designer?** **“**I’m a UI/UX Designer at Link Digital, and I work mostly on data portals, especially CKAN-based portals. My work can be on different levels. Sometimes I design a portal from scratch for a new project. Sometimes, I redesign an existing portal to make it more modern and easier to use. I also help improve consistency. For example, making sure the portal follows a design system, so everything looks and works in the same way. I also design new features, like better search, filtering, previews, dashboards, or map views. And very often, I focus on improving user flows, so people can find the right dataset faster and reach their goal.**“** ## **What are the most common UI/UX mistakes you see on many of the data portals worldwide?** **“**I would say that the biggest mistake is that most portals are built around the data structure and not around what people want to do on the portal. People can come with a simple goal, but sometimes the portal doesn’t guide them properly. Sometimes search and filters are not so easy to use, and data discovery can be confusing. Another common issue can be that the portals don’t have correct UI stats (or metrics). It’s very simple to develop those states, but I’ve seen a lot of portals that don’t have error states, empty results, errors, or loading. There’s a common example: when a user searches for information, he would open several data sets. Sometimes it’s more than ten (10) data sets. And when the data set page is overloaded with information, and this page isn’t structured, \[the\] user has to spend a lot of time reading loads of text before they understand simple points, such as location, publication date, and the time period of the data. So this discovery process becomes difficult for users.**“** A simple improvement is to restructure the data set page, highlight key details at the top, and help users understand the data set in a few seconds. ## **What about organisations running a data portal without a UI/UX expert on their team, what best practices would you recommend?** **“**The first thing I would advise is to focus on the top user tasks. We call them representative tasks. In simple words, a team can focus on user goals and ask about the five common tasks users do on a portal. Usually it can be searching, filtering, understanding the data set, and downloading flow. Then when we refine these representative tasks, we can make quick usability checks.**“** Anastasiia shares that you don’t need a big study. Ask people to try a task and watch where they struggle. **“**I like one phrase from one UX designer, Vitaly Friedman. He says small tests can reveal big issues, and that’s really true. Also, keep the interface simple and predictable. Clear labels, consistent buttons, and good spacing can improve UX a lot.**“** ## **What are some accessible tools that organizations with a limited budget or no on-staff designer, can use to improve their site’s UI/UX?** **“**A lot can be done with simple tools. For quick markups of pages or portals, the best tool is Figma. It’s great for creating layouts with some clickable prototypes and it really helps to test it fast.**“** For user testing, Anastasiia recommends a few tools that work really well even for small teams. - [Optimal Workshop](https://www.optimalworkshop.com/): great for testing navigation, menus, and information structure - [Maze](https://maze.co/): good for testing Figma prototypes, with recordings and heatmaps - [Sondar](https://www.sondar.ai/) and [Wondering](https://genai.works/applications/wondering): these are newer tools, and they use AI to help analyze feedback. They can also include real user testing, recordings, and follow-up questions. Even if a team doesn’t have a big budget, doing just a few small tests like this can quickly show what users find confusing. ## **What are your tips for better accessibility?** Anastasiia offered the following tips: - Use good contrast and readable font sizes so text is easy to read for everyone. - Make sure the portal works with a keyboard, so users can tab through the page and clearly see where they are. This is called a focus state. - Also, even if you’re not an accessibility expert, Figma can help. There are plugins like Able, which are accessibility assistants that quickly check contrast and basic accessibility issues. So teams can catch problems early, even before development. ### **But what if a team needs to urgently do one thing to improve their portal design this week?** **“**I would improve the search function. The search and discovery flow is the most important user flow on the portal. Everything can be perfect, the design can be perfect, and the dataset page can be perfect but if users can’t find the right information or the right data set, everything becomes frustrating without the working search flow. I would focus on such improvements as filtering, sorting, and adding the predictive search suggestions. That shows relevant datasets while the user is typing. It helps users move faster and reduces ‘no results’ situations.**“** According to Anastasiia, these basic improvements can take a few days to one or two weeks, depending on the portal and what’s already in place. ## **What signals should portal teams look at to understand if their design is working?** Anastasiia likes to look at signals that show if users can complete their tasks. For example: - Are people finding data sets and downloading them? - How often do users refine search results with filters? - Do users leave quickly from data set pages? - Do people return to the portal? She also mentioned that qualitative feedback is important. **“**Analytics can tell you what happens, but user comments tell you why. Vitaly Friedman often talks about designing for real behavior, not assumptions, and metrics help you see that behavior. [Google Analytics](https://developers.google.com/analytics) is good for basic tracking. [Hotjar](https://www.hotjar.com/) provides recordings and heatmaps.**“** ## **What’s one piece of advice you’d give to someone who knows their data portal needs design work but doesn’t know where to start?** **“**My advice is don’t try to redesign everything at once. Usually I start with a simple UX review. Focus on the key user journeys, like search, data set pages, and downloading, and identify where users get stuck. Then our team forms an improvement roadmap to work on the most important tasks first. This approach we use at Link Digital helps our clients to get quick wins and build a further improvement strategy.**“** Improving a data portal doesn’t require a total overhaul overnight. As Anastasiia points out, focusing on your top five user tasks and making small, iterative improvements, like refining your search filters, can dramatically improve the user experience. The key is to step back from designing for the data and start designing for the people who use it. [You can watch the full recording of my conversation with Anastasiia here on Link Digital’s YouTube channel.](https://www.youtube.com/watch?v=BEivey1iAPI&t=61s) **Categories:** All articles **Tags:** open data, UI/UX design --- ### [How to create custom chart previews on CKAN for faster data insights](https://linkdigital.com.au/news/2026/02/how-to-create-custom-chart-previews-ckan/) **Published:** February 27, 2026 **Author:** Kate Sampher **Content:** *This article is co-authored with Oleksandr Cherniavskyi, CKAN Lead Developer, Link Digital* Tables and raw numbers are not always the easiest formats for exploring. **Released by Link Digital**, ***ckanext-charts*** adds chart previews to the resources of the [Comprehensive](https://ckan.org/)[ Knowledge Archive Network (CKAN)](https://ckan.org/), allowing users to visualise data directly in the portal. This extension transforms how users interact with datasets, providing instant, visual clarity directly within the CKAN interface. ## *Two ways to use ckanext-charts* **1) Portal-maintained chart previews** This mode is designed for portal maintainers and dataset publishers. They can configure a chart preview for a resource so that all users see the same chart when opening it. Depending on the selected chart engine, previews can include interactive features such as hover tooltips, zoom and drag, and exporting the chart. This is useful when a portal wants to provide a **consistent visual preview for key files**. ![consistent visual preview for key files - ckanext-charts by Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/02/ckanext-charts01.gif)Consistent visual preview for key files **2) Chart builder preview (for individual exploration)** The second mode is a chart builder preview, where users can explore the dataset and build their own chart. They can select the data they want to visualise (including time periods), choose columns and axes, and apply filters to focus on what matters. Once ready, the chart can be exported and shared. ![Chart builder preview - Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/02/ckanet-charts02.gif)Chart builder preview ## Why is this useful in CKAN? It helps by: - making datasets easier to explore without downloading files - supporting a more user-friendly preview experience - allowing to highlight the most relevant information ## Extentable for developers For technical teams, *ckanext-charts* is designed to be extendable. Developers can add: - new chart engines (other chart libraries) - new chart types that are not implemented yet The extension also includes detailed documentation that is useful for both users and developers. ## Technical set-up **Note: These steps are for system administrators and/or developers** To install and enable the extension, follow the official documentation: - [**View on GitHub**](https://github.com/DataShades/ckanext-charts/blob/master/pyproject.toml) - [**View on PyPI**](https://pypi.org/project/ckanext-charts/) ## See *ckanext-charts* in action Watch our latest walkthrough to see how easily you can configure and display custom charts: Are you looking for CKAN experts to help you set up your CKAN extensions, or planning to migrate your digital infrastructure to CKAN? [Contact us and let’s discuss it.](https://linkdigital.com.au/services/move-to-ckan/) **Categories:** All articles, CKAN, Open Data **Tags:** CKAN extension --- ### [CKAN Roadmap: stability, speed, and 3.0](https://linkdigital.com.au/news/2026/02/ckan-roadmap-stability-speed-and-3-0/) **Published:** February 27, 2026 **Author:** Kate Sampher **Content:** The CKAN Monthly Live for February looked at the way ahead for the [Comprehensive Knowledge Archive Network](https://ckan.org/). The rest of 2026 is shaping up to be an amazing year for CKAN, headlined by the upcoming release of the next version of the software, CKAN 2.12, and the roadmap towards CKAN 3.0. Whether you’re looking for enterprise-grade stability or next-generation performance, here is what you need to know about the future of your data portal. ![From the CKAN Monthly Live February 2026](https://linkdigital.com.au/wp-content/uploads/2026/02/image-3.png)From the CKAN Monthly Live February 2026 ## **The release of CKAN 2.12 and the roadmap to 3.0** **Version availability:** CKAN 2.12 **Target availability:** Late March 2026 The CKAN core team has structured 2.12 to be the final major ‘2.x’ release. It includes the logic needed to ensure that when you eventually move to CKAN 3.0, your database and file structures are already compatible. **What this means:** Think of this as ‘future-proofing’. By upgrading to 2.12, you aren’t just getting new features; you’re performing the foundational work required for CKAN 3.0. This minimises downtime and migration costs later this year. --- ![Link Digital Senior Solutions Architect, Sergey Motornyuk presented the updates on Advanced File Management System](https://linkdigital.com.au/wp-content/uploads/2026/02/image-5.png)Link Digital Senior Solutions Architect, Sergey Motornyuk presented the updates on Advanced File Management System ## **Advanced File Management System** **Version availability:** CKAN 2.12 (initial phases) Previously, CKAN files were tied to resources. Now, files are independent entities with their own metadata. **What this means:** CKAN is moving away from a one-resource-one-file model to a much more flexible system where files are treated as separate, trackable entities. - **Hybrid cloud:** You can now store massive datasets on **AWS S3** while keeping smaller, sensitive files on a **local private server**, all managed from one dashboard. - **Integrity:** Link Digital’s CKAN experts implemented file-level hashing, so CKAN can now detect if a file has been tampered with or duplicated, saving you storage costs and improving security audits. --- ![CKAN Lead Developer at Link Digital, Yan Rudenko, presented the updates on the Keyset Pagination ](https://linkdigital.com.au/wp-content/uploads/2026/02/image-6.png)Link Digital CKAN Lead Developer, Yan Rudenko, presented the updates on Keyset Pagination *(For a resource with 13M records, it’s now 15x faster)* ## **Major DataStore Performance and Filtering Updates** **Version availability:** CKAN 2.12 **What this means:** If you manage datasets with millions of records, you will see a massive improvement in speed. By switching from traditional offset pagination to the more advanced keyset pagination, the DataStore can now process large resource downloads much faster. [For a resource with 13M records, it’s now 15x faster. ](https://linkdigital.com.au/news/2025/11/ckan-2-12-faster-search-large-dataset-downloads/#:~:text=Thanks%20to%20a%20groundbreaking%20new%20implementation%2C%20that%20same%2013%2Dmillion%2Drecord%20dataset%20now%20downloads%20in%20just%20two%20minutes.%20This%2015x%20improvement%20is%20achieved%20by%20replacing%20the%20old%2C%20inefficient%20method%20with%20keyset%20pagination.)While download times will still naturally scale with the total number of records, this new approach eliminates the performance bottlenecks seen in older versions. **Case Study Spotlight:** By migrating a major data catalogue in Latin America and the Caribbean from proprietary software to CKAN, Link Digital re-engineered the platform’s architecture to achieve data loading speeds up to 2x faster than the original system. [Read the full case study.](https://linkdigital.com.au/case-studies/inter-american-development-bank-open-data-catalogue/) ![Senior Solutions Architect at Link Digital, Ian Ward, introduced the updates on Advanced Filtering system](https://linkdigital.com.au/wp-content/uploads/2026/02/image-7.png) Link Digital Senior Solutions Architect, Ian Ward, introduced the updates on Advanced Filtering system Additionally, Advanced Filtering is being introduced, allowing for complex searches, such as finding data within specific date ranges or using and/or logic, directly through the datastore\_search API and data tables view. [If you want to know more about this you can check out the article on our site about recent changes to large dataset downloads.](https://linkdigital.com.au/news/2025/11/ckan-2-12-faster-search-large-dataset-downloads/) --- ![New midnight blue modern UI](https://linkdigital.com.au/wp-content/uploads/2026/02/image-9.png)New midnight blue modern UI | Presented by Adria Mercader ## **The new midnight blue modern UI** **Version availability:** CKAN 2.12 (Optional)/CKAN 3.0 (Default) **What this means:** CKAN 2.12 introduces a new, optional theme called ‘Midnight Blue’ that offers a modern, professional look and feel. Beyond aesthetics, it uses HTMX – an open-source front-end JavaScript library that extends HTML for partial page updates. This makes the site feel faster and meets strict WCAG 2.2 AAA accessibility guidelines to ensure your portal is usable by everyone. While it requires manual configuration in 2.12, it will become the standard default in CKAN 3.0. --- ## **ckanext-selfinfo & Collection Frameworks** **Version availability:** CKAN 2.12 and and official extensions In addition to the [*ckanext-collection extension*](https://datashades.github.io/ckanext-collection/)*,* – a way to group datasets, users, and orgs for bulk processing – a new extension was discussed, *ckanext-selfinfo*. This gives [portal administrators important real time system](https://linkdigital.com.au/news/2025/02/ckan-for-geographic-information-systems-capable-data-portals-why-its-the-smart-choice/), usage and error telemetry directly into their CKAN instance. **What this means:** - **Easier maintenance:** [*ckanext-selfinfo*](https://github.com/DataShades/ckanext-selfinfo) gives your team the ability to check system health and errors, and install plugins directly from the UI. No more needing a developer to log into the server just to see why something isn’t working. - **Bulk actions:** The *ckanext-collection framework extension* means you can finally export or manage collections of datasets (e.g., ‘All Education Data 2025) in one go, rather than clicking through them one by one. ## **Prepare for upgrading to CKAN 2.12.** If you need help upgrading to CKAN 2.12, [message Link Digital](https://linkdigital.com.au/get-in-touch/) to discuss how we can help. --- **More articles** - ## [Better Stats for CKAN: Turn your portals activity into insight you can act on](https://linkdigital.com.au/?p=18515) - [![Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/wp-content/uploads/2026/09/1-Bot-traffic-and-vulnerabilities.webp)](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) ## [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) - [![CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/wp-content/uploads/2026/09/CKAN-212-Upgrade.webp)](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) ## [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) **Categories:** All articles, CKAN, Industry, Open Data, Technology Infrastructure, Topics **Tags:** CKAN --- ### [The Objective Observer Initiative and the challenge of being fully open](https://linkdigital.com.au/news/2026/02/the-objective-observer-initiative-and-the-challenge-of-being-fully-open/) **Published:** February 12, 2026 **Author:** Andrew Nette **Content:** What if just making data open and shareable is no longer enough? For Link Digital – a global company that uses open source software tools to build digital platforms that manage and share data – this is not a question asked lightly. In addition to sharing data, we believe what is needed is ‘verifiable honesty.’ This is a core purpose behind the [Objective Observer Initiative](https://linkdigital.com.au/link-lab/) (OOI), which attempts to blend philosophy, open data, AI and digital platforms into a new digital ecosystem framework that is more transparent, objective, and accountable. Why Link Digital is working on this was the subject of a recent keynote by Link Digital Executive Director [Steven De Costa](https://www.linkedin.com/in/stevendecosta?originalSubdomain=au), delivered at the [Everything Open conference in Canberra, Australia](https://everythingopen.au/). It was the second public outing of the thinking behind the OOI, the first being a presentation by Steven at the [Canadian Open Data Summit](https://opendatasummit.ca/) late last year. ![Photo: Everything Open Conference Canberra 2026 Photo by: Daniel Black](https://linkdigital.com.au/wp-content/uploads/2026/02/EO-conf-StevenJPG-scaled-1024x683.jpg)*Everything Open Conference Canberra 2026 Photo by: Leonard Low* The following article will briefly look at the OOI and some of the points raised by Steven’s recent talk about the thinking behind it. ## Being attentive to the signals in data The OOI draws on over two decades of involvement by Steven in the open data/open source ecosystem. But its direct roots come from more recent events that are putting pressure, not just on Link Digital’s business model, but on the notion of openness more generally. A perfect storm of rising authoritarianism, increasing disinformation – making it hard to achieve any sense of shared understanding or consensus formation – and the technological disruption of AI. As Steven puts it, this has led to a realisation that: “While technology has the potential to provide productivity gains, through automation or other means, there is a very real structural change occurring when we employ technology in knowledge operations. Knowledge is something that is constructed, so it takes shape and can certainly be optimised, compressed and distorted. It can be alluring to suggest that the discovery and access to knowledge is a universally beneficial development, but the technology we are employing will consider shared understanding to be of the same category as shared ignorance.” To put it another way, feeding data into opaque machine learning tools and passively receiving the results that emerge on the other side, is not enough. This situation – largely where we are at now – relies on clicks as a signal for consent, efficiency as a sign of value, and does not consider the fact that data can contain different signals that we need to be attentive to. “Datasets contain both information and signal potential. Where data might be combined and used as part of a corpus of signals for the outcome of developing a model, machine learning presents us with the opportunity to not only share the data we have, but to actively construct and share the data we need to train models with the optimism of a healthy, cohesive and well informed society.” ## Rethinking the role of data in creating trust As Steven put it in his Everything Open keynote, an added urgency was injected into his thinking with the advent of the Trump presidency in early 2025. That event was one of several – including Russia’s invasion of Ukraine and lingering dissatisfaction around the response to the Covid 19 pandemic – that made the notion of trust, and why it is declining towards institutions such as government, a central concern of social discourse. These developments also posed the question more sharply of how we reverse this trend and build greater social cohesion, and what role open data might play in this. Of course, trust is a human thing. It is also causally part of a system dynamic. In our current digital set up, we have access to data but lack causal continuity; the ability to agree on how the present came to be. The OOI posits that this can only emerge when our digital systems remain observable, communicable, externally accountable, and truly open. But the difficulties of constantly verifying honesty are huge, which led to the idea of trying to replicate trust within the framework of the open data ecosystem. And central to this was the realisation that people who act in a technological setting need to have a statement of intent. The OOI emphasises explicit, accountable declarations of intent in relation to digital platforms, rather than implicit trust in opaque, black box systems. Instead of simply agreeing to terms we almost never read, individuals that create and interact with our digital systems would publish clear statements about how they intend to act or use data, and then those statements could be objectively verified for compliance. As Steven put it in his Everything Open keynote: “Without a statement of intent, you have no baseline by which to understand, are they moving though the substrate, are they doing things right?” With these statements of intent, we can assess, if we want to, whether they are acting along the lines of their intentions. ## **The OOI as a signal referee** The OOI aims to act as a signal referee, of sorts, not only asking what patterns we can extract from data but anchoring signals to explicit commitments from those who create the systems and use the data, observing whether they are being honest in the way they operate and meet these. This pushes back on the assumption that these signals are a form of truth that can emerge when we run enough data or statistics into machine learning tools. Rather, it posits these signals are relationships between data, intent, and observation. In this regard, the OOI doesn’t just ask what patterns can we extract from data? It asks, do the observed outcomes match the stated intent? This differs markedly from our current digital set up where the main measurement of satisfaction in relation to our engagement with digital platforms is clicks and efficiency the only signal for consent. In his keynote Steven provided an example of how the OOI might act to combat disinformation. Rather than just attempting to passively inoculate citizens against propaganda, the OOI is aligned to attenuate the population towards constructive, optimistic outcomes, to create a clear ‘signal’ for them to invest in. ![Steven De Costa presenting his topic on Everything Open Everywhere All At Once at the said event in University of Canberra | Photo by Daniel Black](https://linkdigital.com.au/wp-content/uploads/2026/02/IMG_5558-scaled-1024x683.jpg)*Steven De Costa presenting his topic on **[Everything Open Everywhere All At Once](https://docs.google.com/presentation/d/1e5vQJTQx3qYcx41NW03_PfkpP65BoQbuvh7fxvHRD20/edit?usp=sharing)** at the said event in University of Canberra | Photo by Leonard Low* ## **Moving toward co-construction** The OOI is already influencing Link Digital’s work with data portals. As Steven puts it: “There is a natural crossover between data portals and websites, and the need for organisations to have a mature understanding of what ‘signals’ they are publishing along with their data, documents and web pages. Importantly, there is an opportunity to co-construct datasets that provide optimistic signals. Such datasets would naturally be made discoverable on portals such as those we develop and maintain for our clients using CKAN, Drupal and other open technologies. “ Link Digital is now entering the experimentation phase of the OOI, in which we want to explore how to develop a model of open technology based on transparent intent and shared cadence, and how open communities can move beyond just accessing data to using that data to fashion a shared coherence. In his Everything Open keynote – [which you can watch in its entirety here](https://www.youtube.com/watch?v=ScLu6igd7Ho) – Steven discussed the first of these experiments, which involves attempts to observe and capture a minute. We will make the outcomes of this experiment an interoperable public dataset and see what products can be engineered from it. You can get the full details of what is involved around the [28:39 minute mark of Steven’s talk](https://youtu.be/ScLu6igd7Ho?t=1719). ## **An invitation to collaborate** While the OOI is a Link Digital initiative, it is vital to stress that we profess no ownership of it. The OOI is an idea and an opportunity, and we extend an invitation to anybody that is interested to build systems and societies that are verifiably honest by design. Work related to the OOI is open by default, [and you can find a full history of the ideation phase online here](https://opendata.ly/)[.](https://opendata.ly/) [You can register your interest in joining us in co-constructing the OOI here](https://docs.google.com/forms/d/e/1FAIpQLScVHVh2J1xhFbjQiknS48bgeTGCfk-f11R7UmVOSKJms5myEQ/viewform)[.](https://docs.google.com/forms/d/e/1FAIpQLScVHVh2J1xhFbjQiknS48bgeTGCfk-f11R7UmVOSKJms5myEQ/viewform) --- [All code generated by the OOI is public infrastructure and will be available here](https://opendata.ai/)[.](https://opendata.ai/) **Categories:** All articles, Artificial Intelligence, CKAN, Drupal, Industry, Objective Observe Initiative, Open Data, Steven De Costa **Tags:** CKAN, CKAN community, Objective Observer Initiative, open data --- ### [Enhancing user journeys: better navigation control in CKAN](https://linkdigital.com.au/news/2026/02/enhancing-user-journeys-better-navigation-control-in-ckan/) **Published:** February 4, 2026 **Author:** Kate Sampher **Content:** Link Digital rolled out significant updates to the **ckanext-menu** extension, focused on making portal navigation more stable for administrators and more flexible for designers. ![ckanext-menu by Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/02/img-ckanext-menu-1024x576.webp)CKAN extension by Link Digital: ckanext-menu ## **Beyond hard-coded links** In the past, managing website menus in CKAN often required a trade-off between technical rigidity and manual effort. If you wanted a multi-level dropdown menu, you often had to hard-code HTML into your theme, making even small link changes a task for the development team. ![ckanext-menu-Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/02/image-1-1024x300.png)The latest updates to [ckanext-menu](https://github.com/DataShades/ckanext-menu) will treat your site’s navigation as **structured data** rather than just static text. ![ckanext-menu-navigation](https://linkdigital.com.au/wp-content/uploads/2026/02/image-1024x502.png)## **What’s new for our community?** Developed with the evolving needs of Link Digital customers in mind, these updates focus on three key areas: - **Hierarchies:** We’ve refined the internal logic that handles ’parent-child’ relationships. Whether you are nesting a ‘Climate Data’ sub-menu under a ‘Regional Reports’ tab, the hierarchy remains stable and predictable, ensuring users never hit a dead-end or a broken link. - **Design freedom:** The extension can now output your menu as a structured list. For our design-conscious users, this means your navigation can finally be ‘style-agnostic.’ Whether it’s a sidebar, a footer, or a mobile-first ‘hamburger’ menu, the data flows perfectly into any custom interface without being tied to a specific HTML format. - **Customisation:** the menu can also be updated directly through the UI making it easy to maintain portals without requiring developer intervention or configuration file edits. ## **Why this matters for your portal** As a site administrator, you can now restructure your portal’s navigation to highlight seasonal data or new initiatives without worrying about breaking the site’s layout. For the end-user, it results in a seamless, professional browsing experience that feels cohesive across every page. By moving toward a more logical, data-driven menu structure, we are ensuring that CKAN portals remain modern, accessible, and most importantly, easy to explore. *Note: This article was co-authored by [Yan Rudenko](https://www.linkedin.com/in/yan-rudenko-03783a112/), CKAN expert at Link Digital.* --- Having issues in your CKAN-based data hub? [Message Link Digital.](https://linkdigital.com.au/get-in-touch/) **Also read: [CKAN updates on real-time site monitoring and improved syndication](https://linkdigital.com.au/news/2025/12/ckan-updates-real-time-site-monitoring-and-improved-syndication/)** **Categories:** All articles, CKAN, Environmental/Climate Change, Government, Higher Education/Research, Industry, Non-profit/NGO, Resources, Technology Infrastructure, Topics, Tutorial **Tags:** CKAN --- ### [CKAN updates: Real-time site monitoring and improved syndication](https://linkdigital.com.au/news/2025/12/ckan-updates-real-time-site-monitoring-and-improved-syndication/) **Published:** December 17, 2025 **Author:** Andrew Nette **Excerpt:** Link Digital is pleased to announce two updates to CKAN, ckanext-selfinfo and syndication 3.0.0. Read the updates from CKAN experts of Link Digital. **Content:** Show topics Hide - [Overview](#aioseo-overview) - [Real time diagnostic monitoring in your CKAN](#aioseo-real-time-diagnostic-monitoring-in-your-ckan) - [What the extension includes:](#aioseo-what-the-extension-includes) - [1. Selfinfo: System & telemetry dashboard](#aioseo-1-selfinfo-system-telemetry-dashboard) - [2. Selftools: Admin utilities for CKAN internals](#aioseo-2-selftools-admin-utilities-for-ckan-internals) - [3. Selftracking: Lightweight usage and interaction tracking](#aioseo-3-selftracking-lightweight-usage-and-interaction-tracking) - [What’s new in version 2: highlights](#aioseo-whats-new-in-version-2-highlights) - [1. Enhanced user interface styling](#aioseo-1-enhanced-user-interface-styling) - [2. Action security improvements](#aioseo-2-action-security-improvements) - [3. Updated and expanded documentation](#aioseo-3-updated-and-expanded-documentation) - [Category configuration updates](#aioseo-category-configuration-updates) - [Major update for CKAN extension Syndication 3.0.0](#aioseo-major-update-for-ckan-extension-syndication-3-0-0) - [Syndication Profiles Dashboard](#aioseo-syndication-profiles-dashboard) - [Syndication Records Dashboard](#aioseo-syndication-records-dashboard) - [Resyndication](#aioseo-resyndication) ## Overview The following article was written by Link Digital CKAN developers Yan Rudenko and Alexandr Cherniavski. Link Digital is pleased to announce two updates to CKAN – the [Comprehensive Knowledge Archive Network](https://ckan.org/). The first is an update for [*ckanext-selfinfo*](https://github.com/DataShades/ckanext-selfinfo), an extension developed by [Yan Rudenko](https://www.linkedin.com/in/yan-rudenko-03783a112/) which gives administrators a crucial, real-time overview of system, usage, and error telemetry directly in the CKAN interface. The second is a major update for Alexandr Cherniavski’s [*ckanext-syndicate*](https://github.com/aptivate/ckanext-syndicate), which lets a user copy – or syndicate – datasets from one instance of CKAN to another. Let’s check out both extensions and what they can do. ## **Real time diagnostic monitoring in your CKAN** The [*ckanext-selfinfo*](https://github.com/DataShades/ckanext-selfinfo) extension is a lightweight but powerful operational toolkit designed to give CKAN administrators and developers real-time visibility into the health, performance, and configuration of their CKAN instance, directly inside the CKAN interface. It reduces diagnostic time, improves transparency, and helps teams maintain stable, production-ready deployments. ![Image of ckan-selfinfo dashboard](https://linkdigital.com.au/wp-content/uploads/2025/12/image-1024x692.png)*ckan-selfinfo dashboard* Running CKAN often requires switching between server logs, CLI tools, monitoring dashboards, and configuration files. *Ckanext-selfinfo* centralises key operational data in one place, giving administrators an immediate understanding of: - system resource usage - CKAN configuration state - extension versions and git commits - search index status - error traces - traffic patterns and user interactions This makes troubleshooting and performance monitoring faster and more accessible, especially in environments with limited DevOps access. ### **What the extension includes:** #### ***1. Selfinfo: System & telemetry dashboard*** A consolidated overview of your CKAN instance, including: - CPU, RAM, and disk usage - CKAN configuration overview (filtered for safe display) - Installed extensions & version details - Git branch and commit information - Error logs and alerts - System events and runtime signals All of this is available in a clean UI panel within the CKAN administration section. #### ***2. Selftools: Admin utilities for CKAN internals*** Practical tools for developers and power-admins: - SOLR index information & quick checks - Database inspection tools (safe queries/metadata only) - Redis-based operations for cache, throttling, and tracking - Quick access to CKAN internals without SSH These tools streamline maintenance tasks, especially in cloud or containerized setups where shell access is limited. #### ***3. Selftracking: Lightweight usage and interaction tracking*** By default, Selftracking captures **page view events** and **API call activity**, storing them for lightweight telemetry. The module is designed to be extensible: developers can register additional event types, implement custom tracking handlers, and integrate the collected data into analytics pipelines, auditing tools, or automation workflows. ### **What’s new in version 2: highlights** #### ***1. Enhanced user interface styling*** A completely refreshed UI with improved layout, clearer grouping of categories, and an overall better admin experience. The new design makes system insights easier to read and interact with. #### ***2. Action security improvements*** New configuration option *ckan.selfinfo.actions\_prefix* allows adding custom prefixes to all Selfinfo actions. This adds an additional layer of security through obscurity and helps avoid naming conflicts with other extensions. #### **3. Updated and expanded documentation** Documentation has been rewritten with clearer examples, expanded setup instructions, and more complete configuration guides to simplify onboarding and troubleshooting. ### **Category configuration updates** Default behaviour has changed. Categories are no longer enabled automatically. - **Selfinfo:** - Only platform\_info is enabled by default - Status\_show has been removed from available categories and added automatically - **Selftools:** Only Solr category is enabled by default Admins must now **explicitly configure** which categories they want to enable. ![CKAN updates: improved ckanext-syndicate](https://linkdigital.com.au/wp-content/uploads/2025/12/ckanext-syndicate-1024x576.png) ## **Major update for CKAN extension Syndication 3.0.0** The [ckanext-syndicate](https://github.com/DataShades/ckanext-syndicate) extension has been updated to version 3.0.0. This major release brings a complete overhaul, from internal code and tests to an entirely new user interface. Syndicate’s primary goal is to push datasets to remote portals, enabling a single data provider to distribute data across multiple open-data portals. Portal maintainers specify profiles that represent remote portals. Each profile contains information about the remote CKAN instance, authentication credentials, and other configuration settings. The main issue we aimed to solve was the lack of observability. Previously, syndication happened in background jobs with output written only to log files. Users initiating the sync process from the web UI were often unaware of the outcome. The process complexity stems from several factors, primarily remote portal availability and dataset schema differences. Changes to a schema on a remote portal can break syndication. Similarly, modifying data on the source portal may trigger incompatibility with the remote portal’s schema. These issues need to be obvious and easily resolvable. To track every syndication record, we’ve created a web UI (available only to sysadmins) that helps you monitor all enabled profiles and their records. [CKAN Syndication 3.0.0](https://linkdigital.com.au/wp-content/uploads/2025/12/CKAN-Syndication-3.0.0.pdf)[Download PDF](https://linkdigital.com.au/wp-content/uploads/2025/12/CKAN-Syndication-3.0.0.pdf) ### **Syndication Profiles Dashboard** You can access the syndication profile dashboard by clicking the button in the header next to your profile name. ![ckan-syndication dashboard](https://linkdigital.com.au/wp-content/uploads/2025/12/image-1-1024x209.png)*Syndication Profiles Dashboard Button* Clicking the button opens the dashboard with all profiles listed. On this page, you can see the profile name, remote portal URL, and all other profile-related data. The dashboard table is powered by the [*ckanext-tables*](https://docs.ckan.org/en/latest/maintaining/table-designer.html) extension, which allows us to build complex tables with sorting, filtering, and pagination quickly and easily. ![syndication profiles list](https://linkdigital.com.au/wp-content/uploads/2025/12/image-2-1024x644.png)*Syndication Profiles List* Because each profile contains extensive information, we’ve added a button in the Details column that opens a modal window showing all profile information. Here you can verify whether the API key is set, view the remote portal URL, check the profile queue name, and review other settings. ![CKAN update: Syndication Profile Details Modal](https://linkdigital.com.au/wp-content/uploads/2025/12/image-3-1024x676.png)*Syndication Profile Details Modal* ### **Syndication Records Dashboard** From the syndication dashboard, you can access the records dashboard by clicking the button with three dots and selecting View logs. This opens a new page displaying all records related to the profile. ![CKAN Updates: Syndication Records Dashboard Button](https://linkdigital.com.au/wp-content/uploads/2025/12/image-4-1024x567.png)*Syndication Records Dashboard Button* The records dashboard contains all records associated with the profile. Each record represents a dataset that was or wasn’t successfully syndicated to the remote portal. You can see the dataset title, local and remote IDs (if syndicated successfully), state (synced, failed, stopped), error message (if any), and timestamp. ![CKAN Updates: Syndication Records Dashboard](https://linkdigital.com.au/wp-content/uploads/2025/12/image-5-1024x589.png)*Syndication Records Dashboard* The *ckanext-tables* extension enables you to filter records, apply actions to selected records (such as resyndicating selected packages), and export records in different formats: CSV, JSON, Excel, TSV, YAML, NDJSON, HTML, and PDF. You can also resyndicate a single record by clicking the respective button in the three-dots menu. **Syndication States** A syndication record can have several states: - Synced – the dataset was successfully syndicated to the remote portal. - Failed – the syndication process failed due to an error. The error message is displayed in the respective column. - Stopped – the syndication process was stopped by the skip\_syndication hook. This can occur when a dataset shouldn’t be syndicated based on certain conditions. #### **Resyndication** The new UI makes resyndication much easier. You can resyndicate a single record, selected records, or an entire profile. When you resyndicate a record, a new task is created in the background queue. To ensure resyndication isn’t blocked by other tasks, we’ve added a queue setting to each profile. This allows multiple profiles to work in parallel without blocking each other. By default, the default queue is used. ### **Conclusion** [Syndication 3.0.0](https://github.com/DataShades/ckanext-syndicate) represents a significant step forward in making dataset syndication more transparent, manageable, and reliable. The new dashboards provide unprecedented visibility into syndication operations, while the improved architecture ensures better performance and maintainability. We encourage all users to migrate to this new version and explore the enhanced features. For questions or issues during migration, please visit our [GitHub repository](https://github.com/DataShades/ckanext-syndicate) or reach out to the [community](https://app.gitter.im/#/room/). **Categories:** All articles, CKAN, Digital Public Infrastructure, Internal data hub, Open Data, Resources, Technology Infrastructure, Topics, Tutorial **Tags:** CKAN updates --- ### [2025 in review: Four highlights that shaped Link Digital this year](https://linkdigital.com.au/news/2025/12/2025-in-review-four-highlights-that-shaped-link-digital-this-year/) **Published:** December 17, 2025 **Author:** Andrew Nette **Excerpt:** From the organisations with which Link Digital collaborates, CKAN contributions and global impact, leadership, new challenges, and new service offerings. Read the article now. **Content:** From the shift in the global order post the election of Donald Trump to the relentless way AI now dominates discussions about tech and so much else, it’s hard not to feel like 2025 was the year in which, after a long time of nothing changing, suddenly it felt like everything was shifting. And fast. Over the last 12 months, it has become clear to Link Digital that open data still has a vital role to play in everything from creating a more equitable and ethical AI to driving economic growth and greater trust in government. And, just as we have since Link Digital came into being in 2002, we remain laser focused on continuing to provide quality services using open source software such as CKAN – [the Comprehensive Knowledge Archive Network](https://ckan.org/). But we can also see that the open data ecosystem is rapidly evolving, and Link Digital is excited to change with it. ![How artificial intelligence could change digital public infrastructure](https://linkdigital.com.au/wp-content/uploads/2025/11/3-AI-adoption-by-government-1024x535.webp)Here are four milestones that made 2025 a rewarding year but which also presented us with exciting new challenges. ## **Global collaborations** Providing our clients with high quality tailored solutions to their digital and data needs remains absolutely core to what we do. In 2025, we worked with a wide range of clients, including governments, not for profits, and academic institutions. One of the most significant international projects we completed in 2025 was modernising the Inter-American Development Bank’s (IDB) [existing open data catalogue, including transitioning it from proprietary software provider to open source CKAN](https://data.iadb.org/). It was a complex job, requiring considerable out of the box thinking on our part, primarily related to how to deal with the size of some of the IDB’s datasets, far larger than those typically hosted on CKAN catalogues and open data portals. We helped another multilateral organisation [modernise and future proof its enterprise level public data catalogue, to make it more secure and efficient](https://linkdigital.com.au/case-studies/data-catalogue-food-security/). We delivered a tailored CKAN data and statistics platform [to improve the internal data organisation and search capacities of the design department of a major university in northwestern Europe](https://linkdigital.com.au/case-studies/ckan-data-statistics-platform-european-university/). And we assisted a longstanding client – the [Pacific Data Hub](https://pacificdata.org/), run by the principal scientific and technical organisation supporting development in the Pacific region – to successfully migrate their site to the latest version CKAN, enabling it to take advantage of the latest file extension capabilities and performance improvements. ![Interview: Mapping Digital Public Infrastructure Globally](https://linkdigital.com.au/wp-content/uploads/2025/12/Mapping-DPI-globally-1024x535.webp)Illustrating the trusted reputation and steady growth of our Canadian subsidiary we continued to work with the University of Manitoba’s [Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/), on the increasingly complex requirements of its [Canadian Watershed Information Network site](https://canwinmap.ad.umanitoba.ca/). We were first engaged to overhaul the site in 2020, and this year we implemented a distributed ecosystem with CKAN as the central hub and adding a sophisticated Drupal component. And we also worked on the [Quebec Regional Transport Authority Data Platform](https://www.artm.quebec/), the government transportation authority that plans, finances, and integrates public transport in Greater Montreal in Quebec, Canada. The project involved the establishment of a public data hub and an internal data catalogue, enhancing data management and accessibility for public visitors, authenticated data consumers, and Authority staff. Link Digital also continues to service a range of Australian clients. In 2025 this included working with the NSW Department of Climate Change, Energy, the Environment and Water [to implement an innovative and cost effective solution to make their local-scale climate datasets](https://linkdigital.com.au/case-studies/sharing-and-enabling-environment-data-portal/) more discoverable and shareable to a broad range of stakeholders and users, in a highly secure environment. ## **Contributions to CKAN that have global impact** It has been another big year for Link Digital’s role as one of CKAN’s co-stewards. Over 2025 we continued to build our deep knowledge of and involvement in the governance, community engagement and technical development aspects of CKAN. As part of this, our dedicated team of experts contributed numerous extensions or improvements to CKAN’s core software, which will benefit all the software’s users. These include: - Improved viewing of GeoPackages – a file format that enables the design and viewing of maps with layers – in CKAN through the development of a new extension, [*ckanext-gpkg-view*](https://github.com/DataShades/ckanext-gpkg-view). [You can read about it in more detail here](https://linkdigital.com.au/news/2025/06/introducing-link-digitals-new-geopackage-extension-for-ckan/). - A major change to CKAN’s core that will make large data downloads on CKAN up to fifteen times faster. This change, [which you can get more detail here](https://linkdigital.com.au/news/2025/11/ckan-2-12-faster-search-large-dataset-downloads/), will be available in the next version of CKAN – 2.12. - An update to [*ckanext-selfinfo*](https://github.com/DataShades/ckanext-selfinfo), an extension developed by one of our team members, which gives administrators a crucial, real-time overview of system, usage, and error telemetry directly in the CKAN interface. - A major update for the [*ckanext-syndicate*](https://github.com/aptivate/ckanext-syndicate) extension, which enables a user to easily copy – or syndicate – datasets from one instance of CKAN to another. - [CKAN Sync for Drupal](https://www.drupal.org/project/ckan_sync), an innovative module that allows developers to seamlessly connect their Drupal site menu structure with any CKAN-enabled open data management system via RESTful API. - Improvements to CKAN’s file management capabilities, enabling better tracking, audit trails, and sharing flexibility. ![Canadian Open Data Summit 2025: Opportunities and threats for open data movement](https://linkdigital.com.au/wp-content/uploads/2025/12/1-CODS-2025-1024x535.jpg) ## **Thought leadership** Link Digital’s commitment to the open data ecosystem not only concerns data as a driver of economic value. This was apparent from the range of international forums we were involved in in 2025. A key theme in nearly all these events is that while the open data movement has reached a significant level of maturity and continues to be seen as vital, the concept of openness – economic, political, technological, dated related – is under growing pressure, including from unethical AI, authoritarian political currents and disinformation spread by malicious actors. Link Digital staff attended [Berlin’s Creative Bureaucracy Festival](https://creativebureaucracy.org/) in May. A forum for public administrators to discuss how to work smarter and, particularly, to ramp up their use of data and digital to provide more innovative, efficient, and better services, it showcased the massive pressures facing European governments to improve data and digital driven services. The challenges facing open government and the public sector from the *polycrisis* – an increasingly popular shorthand to describe not just the existence of multiple major, mutually reinforcing global crises – were also on display during the [Open Government Partnership Summit 2025](https://www.opengovpartnership.org/events/2025-ogp-global-summit/) (OGP). Link Digital staff were among the more than 2000 participants who came together in Vitoria-Gasteiz, Spain, in early October, to discuss including the algorithmic transparency of AI and trends in civic tech and digital public infrastructure for open government. ![What is digital public infrastructure and can it help reverse the decline in public trust in government?](https://linkdigital.com.au/wp-content/uploads/2025/10/Photo-OGP2025-Andrew-Adria-2.png)*Andrew Nette and Adria Mercader* The CKAN experts of Link Digital led a special in-person workshop as part of the [csv,conf,v9 conference](https://csvconf.com/), in mid-September, in Bologna, Italy. The theme of this year’s conference, ‘Data for Communities’, resonated deeply with Link Digital’s mission of building digital infrastructure that empowers governments, researchers, and communities to make data useful and usable. The workshop provided a general overview of CKAN and a roadmap and vision for CKAN’s future evolution, leading to the software’s next major release, CKAN 3.0. Link Digital’s Executive Director [Steven De Costa](http://linkedin.com/in/stevendecosta/?originalSubdomain=au) attended the [International Data Week (IWD) 2025](https://idw2025.org/) in Brisbane, Australia in mid-October. Hosted by the [Committee on Data](https://codata.org/), the [World Data System](https://www.worlddatasystem.org/) of the [International Science Council](https://de.council.science/), and the [Research Data Alliance](https://www.rd-alliance.org/), IDW brings together data scientists, researchers, industry leaders, entrepreneurs, policymakers and data stewards from across the globe to explore how to leverage the data revolution to improve science and society through data-driven discovery and innovation. De Costa was also among the Link Digital staff that took part in the [Canadian Open Data Summit](https://opendatasummit.ca/). Organised by the [Canadian Open Data Society](https://www.linkedin.com/company/canadian-open-data-society/?originalSubdomain=ca), this year’s CODS was combined with GovMaker Canada, an initiative led by the [Pond-Deshpande Centre at the University of New Brunswick](https://ponddeshpande.ca/govmaker/), focused on advancing public sector innovation and open government. As was the case in the other events, a key focus of the conference was AI, its problems but also how to use it to help with data discovery. ## **New challenges and new service offerings** Link Digital’s core offering remains ‘creating meaningful change’ by helping our clients to make the most of data and digital opportunities through open source technologies like CKAN. But given some of the changes discussed above, the last 12 months have also seen us start the process of developing new service offerings that tackle how the open data and digital ecosystem are evolving. It is no longer enough just to make data more open and shareable. AI is changing traditional digital service interfaces, potentially enabling greater public access to the data that is stored on platforms such as open data portals, but also making interactions with them more complex and multifaceted. And, in turn, this is raising other questions that open source civic tech providers such as Link Digital must engage with, including how AI can be used to create higher quality open data and better open data infrastructure. ![The Objective Observer Initiative](https://linkdigital.com.au/wp-content/uploads/2025/04/Diagram-The-Objective-Observer-Initiative-1.png) On a deeper level, Link Digital is also excited to explore how we might move away from traditional models in which citizens are asked to place their trust platforms and institutions, the basis of a lot of civic technology, to [a new approach in which digital accountability is not only legal or contractual, but it’s *observable, communicable,* and *subject to the verifiability of its own claims*. ](https://linkdigital.com.au/news/2025/05/reimagining-data-systems-for-human-agency/#:~:text=become%20less%20functional.-,The%20Objective%20Observer%20Initiative,-What%20if%20we)And we are also keen to discover how we might use such a system to generate high quality open data sets that can better inform policy making and digital service provision, as well as strengthen government, create a more ethical AI, and deal with issues such as the deliberate spread of disinformation. Early 2026 will see us start to roll out new service offerings in this area. These will be focused on collaboration with various educational, research, and non-profit institutions interested in civic tech, civic engagement, and ethical AI, as well as practitioners interested in participating in civic tech activities. If you’re interested, stay tuned for more details. For now, here’s to a successful 2025 and an even better 2026. Thank you for being part of our journey. **Categories:** All articles, Industry --- ### [How to create brilliant data workflow patterns with CKAN](https://linkdigital.com.au/news/2024/11/how-to-create-brilliant-data-workflow-patterns-with-ckan/) **Published:** November 6, 2025 **Author:** Andrew Nette **Content:** This blog post was co-authored by [Ian Ward, Senior Solutions Architect at Link Digital](https://www.linkedin.com/in/ianward/?originalSubdomain=ca "Ian Ward, Senior Solutions Architect at Link Digital"), with input by Full Stack Developer/Architect, [Sergey Motornyuk](https://www.linkedin.com/in/sergey-motornyuk-a33226108/ "Sergey Motornyuk"). Diagrams are done by [Anastasiia Shevtsova,](https://www.linkedin.com/in/anastasiia-shevtsova-853b15158?) Link Digital UI/UX designer. ## **Table of contents** - [Metadata ingestion](#aioseo-metadata-ingestion) - [Data validation](#aioseo-data-validation) - [Federation](#aioseo-federation) - [Multi-tenant publishing](#aioseo-multi-tenant-publishing) - [Data aggregation](#aioseo-data-aggregation) - [Format conversion](#aioseo-format-conversion) - [Filtering and packaging](#aioseo-filtering-and-packaging) - [Data quality and review](#aioseo-data-quality-and-review) - [Conclusion](#aioseo-conclusion) - [Want to improve your data workflow patterns?](#aioseo-want-to-improve-your-data-workflow-patterns) A data publishing workflow is a structured process for preparing, reviewing and publishing datasets to ensure data quality, maximise accessibility and discoverability, and ensure compliance with any legal and other standards. In a presentation to the recent [2024 Canadian Open Data Summit](https://www.opendatasociety.ca/etn/2024-canadian-open-data-summit/), Ian Ward, Link Digital’s Senior Solutions Architect, outlined some of the great publishing workflows created using the powerful open source software known as [CKAN – the Comprehensive Knowledge Archive Network](https://ckan.org/). Let’s recap this presentation, which set out eight of the tasks required in a data workflow pattern. These were illustrated with examples of CKAN-powered data catalogues and data portals, some of which Link Digital worked on, and the wide variety of extensions which can add additional features and integrations to the CKAN’s core software. ## **Metadata ingestion** Data catalogues and open data portals are built on metadata. The better the metadata, the easier it is for users to find exactly the data they need by searching, filtering or linking from other data sources. In data-oriented organisations publishers will already be tracking metadata about the data they need to share. To publish or update a dataset these organisations just need to convert their metadata into the right metadata schema for ingestion into the catalogue or portal, and push it with an application programming interface or API – protocols and software that enable a connection between computers or between computer programs. The Canadian Government’s national open data portal, [open.](https://open.canada.ca/en)[canada](https://open.canada.ca/en "canada")[.ca](https://open.canada.ca/en) was built using an extensive metadata schema, including controlled vocabularies, fully bilingual fields and geographic information. Using the *[ckanext-scheming](https://github.com/ckan/ckanext-scheming)* extension, this metadata schema becomes a natural part of the [CKAN API](https://docs.ckan.org/en/2.9/api/). New fields work just like built-in fields and appear automatically in forms for users entering metadata, and new and changed validation rules are integrated seamlessly. The [*ckanext-scheming*](https://github.com/ckan/ckanext-scheming) extension uses a JSON data exchange format or YAML-based metadata schema to define all dataset and resource metadata fields, and vocabularies and validation rules, without needing to change or extend the CKAN software itself. Using JSON or YAML data to represent a metadata schema is powerful. Metadata schemas themselves are exposed by an API so they can be shared and built on or integrated into other tools that work with the catalogue metadata. Another approach is used by [Pacific Data Hub](https://pacificdata.org/), an open data portal that serves as a gateway to the most comprehensive data collection of relevance to the 22 Pacific Island nations, which Link Digital helped build. Metadata from many sources, including existing local data portals, old archives and other data sources, is centralised in the data catalogue. This portal periodically collects and combines information using the [*ckanext-harvest extension*](https://github.com/ckan/ckanext-harvest) from many third-party sites, most of which are not CKAN portals. Separate workflows are created with *chanext-harvest* for each individual data source. After receiving the data, rules are used for mapping external data to the expected schema, so data collected from various unrelated sites with completely different structures are displayed as a combined series of datasets. ![Harvesting metadata mapping - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/11/Harvesting-metadata-1024x576.jpg)Harversting metadata mapping ## **Data validation** Data validation involves checking data to ensure it meets quality criteria, such as completeness, accuracy, and reliability. So much published data is raw and unvalidated that it’s estimated between 50 and 80% of the time spent by people using the data is just cleaning it first. Data validation saves users time and makes sure all the data published in a catalogue is usable. For example, data published on open.canada.ca can either be a link to an external resource or a file uploaded into the catalogue. For uploaded files, the [*ckanext-validation*](https://github.com/ckan/ckanext-validation) extension can be used to generate a report (in both Canada’s official languages, English and French) on the data’s validity. This covers off the basics, like ‘are there unique column headings’ and ‘are there any blank or duplicated rows.’ Only when data checks out as valid will it be loaded using [*xloader*](https://github.com/binaryupdates/xLoader) into the CKAN datastore. This data can then be previewed in a searchable table and enabled as a data API. This also acts to encourage users to upload valid data, because while invalid data isn’t prevented from being published, invalid data won’t have the visualisation and API features behind it. ## **Federation** Federation, or republishing metadata already published in other catalogues, can create a one-stop-shop for data users. A good example is another CKAN powered portal developed by Link Digital, and managed by University of Manitoba’s [Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/), [the Canadian Watershed Information Network](https://canwin-datahub.ad.umanitoba.ca/ "the Canadian Watershed Information Network"). An internal data management platform that collects and manages a large array of climate data, including spatial data, and analyses and shares it with researchers, it combines both local and federated data into a single search interface. Federation is run periodically to ensure high-quality results. ![Hybrid search function - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/11/2.-Federated-search-1024x576.jpg)Hybrid search (local and federated) [How to create brilliant data workflow patterns with CKAN](https://linkdigital.com.au/wp-content/uploads/2025/11/How-to-create-brilliant-data-workflow-patterns-with-CKAN.pdf)[Download](https://linkdigital.com.au/wp-content/uploads/2025/11/How-to-create-brilliant-data-workflow-patterns-with-CKAN.pdf) ## **Multi-tenant publishing** A different way to host information from multiple sources, when some of those sources don’t already run their own catalogue, is to give them accounts on a shared CKAN catalogue. For example, [Quebec’s provincial open data catalogue](https://www.donneesquebec.ca/recherche/fr/dataset?organization=ville-de-quebec) has accounts and organisations for its municipalities so they can host and publish data without needing to maintain their own separate catalogue. Since there’s no single vendor for requiring a separate contract for each city, if you run CKAN there’s no restrictions on how you share or run a catalogue. ## **Data aggregation** It can also be useful to aggregate the same data from multiple sources into a single dataset. The [NSW Flood Data Portal](https://flooddata.ses.nsw.gov.au/), which link Digital worked on, involves researchers working in parallel and collecting data for several datasets with a total volume of tens of gigabytes. These datasets consist of many files, and it is time consuming to transfer them individually. In addition, a researcher will register datasets gradually, publishing information that depends on other datasets which haven’t been created yet. This increases the risk of uploading a file to the wrong place, among other errors. A separate program called the [Data Upload Tool](https://help.zoho.com/portal/en/kb/creator/migration-guide/data-upload-tool/articles/data-upload-tool) was created for researchers to run on their computers. Researchers specify the directory with the information and the program shows them approximately which datasets will be created from it. Researchers edit the metadata directly in the program, such as the name, description or license of the dataset. The Data Upload Tool shows them a list of all datasets and all resources that will be included in these datasets. After checking the data, the researcher clicks on a button to validate it using the CKAN API. When all the errors are fixed and the CKAN API says that the dataset can be created, the Data Upload Tool can create all the resources, datasets and upload all the files. The program monitors what has already been created and how much has already been uploaded, so even in the event of a power outage, the researcher will be able to continue uploading exactly from the moment where he or she stopped. Finally, when everything is created, again using the CKAN API, the application tells the portal that it is finished, and all the created data is published together. ## **Format conversion** Depending on your goal and the tools you have chosen, a data file published in a catalogue might not be the ideal format. The [British Columbia Data Catalogue](https://catalogue.data.gov.bc.ca/) generates different data formats for published geospatial data as part of the publishing process. The [City of Toronto Open Data Portal](https://open.toronto.ca/#:~:text=The%20City%20of%20Toronto's%20Open%20Data%20Portal%20is%20an%20open,datasets%20for%20you%20to%20explore.) generates alternate formats for both geospatial and tabular data as part of a pipeline which we’ll touch on in a little more detail under data quality and review. ## **Filtering and packaging** Sometimes data custodians are presented with too much data. Data filtering patterns are used to identify subsets of data based on specific criteria, reducing the volume of data to only what’s necessary for analysis or processing. Data packaging patterns involve structuring, grouping, and storing data in a way that makes it more accessible and manageable. For registered users on the soon to be launched [New South Wales Climate Data Portal](https://www.climatechange.environment.nsw.gov.au/climate-data-portal#:~:text=The%20NSW%20Climate%20Data%20Portal%20(the%20Portal)%20is%20an%20online,Climate%20Modelling%20(NARCliM)%20project.) it is possible to download filtered geospatial data on certain regions or other parameters. When a filtered download is requested, CKAN estimates the time required to generate the data. For quick requests the file is generated and downloaded immediately but when a large amount of data is requested it will be generated in the background and the user will be emailed a link once the process has completed. ![data transformation workflow - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/11/3.-Filtering-and-packaging-1024x576.jpg)Data transformation for a climate data portal ## **Data quality and review** It is vital to always deliver the best quality data to users. Data validation helps but sometimes you need an expert to review data before it’s published. On open.canada.ca new datasets are uploaded to one internal ‘Registry’ CKAN instance and put in a queue to be reviewed. Individual members of the business team check the metadata and data for accessibility and compliance with official language requirements. Once any required changes are made and the dataset is approved it moves to the public ‘Portal’ CKAN instance. The team behind the City of Toronto Open Data Portal go a step further. Departments can’t simply log in and publish data, instead the open data team works with data owners and builds an individual ETL – extract, transform, load – pipeline to process every dataset. These pipelines cache different versions of the data by uploading them to CKAN and push data into the CKAN datastore with awareness of the types and descriptions for every column. This process guarantees that data is always up to date, valid and available through CKAN’s APIs and visualizations, although there are limitations based on ETL resources and the open data team’s time to integrate new datasets. ## **Conclusion** This article has covered some of the workflow patterns enabled by CKAN. Many of the tools referred to above are open source, reusable extensions. Almost anything you might need for a data catalogue or open data portal is possible with CKAN and can help make data more discoverable and higher quality for publishing, internally or externally. ## **Want to improve your data workflow patterns?** [Contact us](https://linkdigital.com.au/get-in-touch/) and one of our data experts will be in touch. **Categories:** All articles, CKAN, DCAT (Data Catalog Vocabulary), Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Internal data hub, Open Data **Tags:** CKAN, data workflow patterns, open data --- ### [Meet Datashades.info: a global index of CKAN data portals](https://linkdigital.com.au/news/2025/10/meet-datashadesinfo-a-global-index-of-ckan-data-portals/) **Published:** October 27, 2025 **Author:** Kate Sampher **Excerpt:** Think of Datashades.info as your intelligence platform for CKAN portals worldwide. Datashades.info tracks real metrics from hundreds of CKAN implementations across governments, universities, NGOs, and enterprises, providing the insights you need to build better data infrastructure. **Content:** This article is co-authored with Sergey Motornyuk and Anastasiia Shevtsova ![Meet Datashades.info: a global index of CKAN data portals](https://linkdigital.com.au/wp-content/uploads/2025/10/1-datashades-blog-1024x535.webp)## **The challenge of building data portals** Whether you’re a government department or agency, a research institution, a not for profit or a corporation, effective data sharing is increasingly critical. You need a platform that handles everything from dataset management to user access, metadata standards to API provisioning. Many organizations turn to CKAN – the [Comprehensive Knowledge Archive Network](https://ckan.org/) – the world’s leading open source data management system. But here’s the challenge: with hundreds of CKAN implementations worldwide, how do you know what works? Which extensions are reliable? And if you’re building a portal, where do you start? ## **What is Datashades.info?** Think of [Datashades.info](http://datashades.info) as your intelligence platform for CKAN portals worldwide. [Datashades.info](http://datashades.info) tracks real metrics from hundreds of CKAN implementations across governments, universities, NGOs, and enterprises, providing the insights you need to build better data infrastructure. Whether you’re exploring CKAN for the first time, planning your implementation, or optimizing an existing portal, Datashades.info offers data-driven intelligence that replaces guesswork with evidence. ## **What you’ll discover** ### **Real performance benchmarks** See actual user counts, dataset volumes, and engagement statistics from CKAN portals across sectors and continents. Understand what success looks like for organizations like yours. ### **Plugin and technology Insights** Discover which CKAN extensions organizations are actually using in production. Learn from proven implementations rather than experimenting blindly. ### **Historical performance trends** Track how portals evolve over time. Watch dataset growth, user engagement patterns, and technology adoption across the entire CKAN ecosystem. ## **Who can benefit from Datashades?** ### **Organizations exploring CKAN** Research what’s possible before committing resources. See real-world examples from your sector and understand realistic timelines and expectations. ### **Teams planning a CKAN implementation** Make informed decisions about plugins, themes, and architecture. Build your requirements based on proven patterns, not theoretical possibilities. ### **Data managers optimizing existing portals** Benchmark your performance against similar organizations. Identify opportunities for improvement based on what’s working elsewhere. ### **Procurement and IT leaders** Evaluate CKAN capabilities with concrete evidence. Build business cases using real data such as versions, and plugins implementations. ## **Why this matters** From research breakthroughs to policy formulation, from business decisions to community engagement, the systems that manage and share data matter immensely. Datashades.info ensures you build on proven foundations rather than reinventing solutions. The site provides competitive intelligence that helps organizations of all types deploy better data infrastructure more rapidly. ## **Built by CKAN experts and community reach** Datashades.info comes from [Link Digital](https://linkdigital.com.au/), co-stewards of the CKAN open source project. For almost two decades, we’ve implemented CKAN-powered data portals worldwide. Datashades.info is our way of helping build a more capable, evidence-informed data community. It connects users with CKAN experts and a global open-source community dedicated to advancing open data practices and offering direct access to shared experience, practical insights, and tailored support for open data strategies. ## **Start your research** Visit[ Datashades.info](https://datashades.info/) to explore the CKAN global landscape. See which approaches are thriving, learn from their technical choices, and discover what makes data infrastructure work in the real world. Because whether you’re publishing government transparency [data, sharing research datasets, or building corporate data platforms,](https://linkdigital.com.au/case-studies/medecins-sans-frontieres-data-sharing-portal/) informed decisions lead to better outcomes. --- *Datashades.info is maintained by Link Digital, co-stewards of the CKAN open source project and specialists in building data infrastructure for organizations worldwide.* **Categories:** All articles, CKAN, Digital Public Infrastructure, Industry, Kate Sampher, Open Data **Tags:** CKAN, CKAN community --- ### [Introduction to updating CKAN templates](https://linkdigital.com.au/news/2024/05/introduction-to-updating-ckan-templates/) **Published:** October 2, 2025 **Author:** Brett Jones **Content:** Central to CKAN’s functionality and user experience are its **templates**, which define the layout and presentation of web pages within the CKAN portal. These templates are constructed using a combination of HTML, CSS, and the Jinja2 templating language, offering a flexible framework for customising the appearance and behaviour of CKAN interfaces. Updating CKAN templates is critical for maintaining the relevancy, accessibility, and aesthetics of a CKAN instance. Whether the goal is to align the portal’s look and feel with organisational branding, enhance user navigation, or incorporate new features, proficient management of CKAN templates ensures that data is presented in a user-friendly and engaging manner. ## **Modifying CKAN Templates** When updating CKAN templates, it is often necessary to modify the **plugin.py** file associated with your CKAN extension. This file is crucial for defining and registering custom templates, ensuring that CKAN recognizes and utilises the updated versions. The **plugin.py** file is part of your CKAN extension and is used to register plugins with CKAN. It tells CKAN which templates to use and can override default templates with custom ones. In **plugin.py**, you need to implement the **IConfigurer** interface, which allows you to specify additional directories for CKAN to search for templates. This is typically done by modifying the **update\_config** method. In our example after generating the ckanext-pigeon extension, we uncomment the relevant lines from the **plugin.py** file as follows: ![](https://lh7-us.googleusercontent.com/Wj4hOWupXn3sFpR_Bg6_dY7eFbsrL6TxEOW4saq3PNo2GdQIikCkWBf9DcjywArTOmA40kochinBdDCCCiJ11wVO8jzv87TivsV2HiszlYwFxhH29RxXOqriBqiIh9fMkAEgrz7cObz3AtSDpsg1H20) We now have a folder to place our custom template artefacts. CKAN will prioritise these templates over the default ones if they have the same name and the same relative path. For this example, we will modify the footer page to use a new image that will be displayed at the bottom of all relevant pages. Specifically for our example, we add the **footer.html** file into **templates/** folder. ## **Here is the footer.html file:** ![](https://lh7-us.googleusercontent.com/KEVy4sXZwFnVTnb9Fdlj_X14GJ_ToIsZgd_poInv045MDt_tb4MrGIT7lhIvccuCxBSeDBxvZk558t3UE6uEBm0gTPFn7hNCS7d0SjL5q09vM-o8irRRyscQvPa-ml-H1_55_lY7mxFD4gH-menxsE4) Here we see that the image file **pigeon.footer.jpg** is inserted into the footer ## **Testing Changes:** After updating **plugin.py** and adding your custom templates and images, restart (or just trigger) your CKAN instance and verify that the changes are reflected. Ensure that the new templates load correctly and that there are no errors in the logs. That’s it! You can also watch[ the 6-minute video](https://www.youtube.com/watch?v=ZnyrOjfq4Dk&t=57s) on [Link Digital YouTube Channel](https://www.youtube.com/@link-digital) *In case you missed the previous tutorials, go to the main [article to explore more topics](https://linkdigital.com.au/news/2024/04/welcome-to-tuesday-tutorial-articles-to-help-you-get-the-most-out-of-ckan/).* --- **Related articles** [How to install CKAN using Docker Containers](https://linkdigital.com.au/news/2024/04/how-to-install-ckan-using-docker-containers/) [How to install DataStore and DataPusher on CKAN](https://linkdigital.com.au/news/2024/05/how-to-install-datastore-and-datapusher-on-ckan/) [Create a CKAN development environment and install a new extension](https://linkdigital.com.au/news/2024/05/create-a-new-ckan-development-environment-and-install-a-new-extension/) **Categories:** All articles, CKAN, Environmental/Climate Change, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data, Resources, Tutorial **Tags:** CKAN --- ### [Too many tools, too little integration, insights on digital curation](https://linkdigital.com.au/news/2025/04/too-many-tools-too-little-integration-insights-on-digital-curation/) **Published:** April 22, 2025 **Author:** Kate Sampher **Excerpt:** My personal impressions of the 19th International Digital Curation Conference (IDCC25). Twenty years back, twenty years forward: lessons and directions in digital curation. **Content:** I just wrapped up an illuminating few days at the [19th International Digital Curation Conference (IDCC25)](https://dcc.ac.uk/events/idcc25) in The Hague. The event’s theme, ‘Twenty years back, twenty years forward: lessons and directions in digital curation’, couldn’t have been more timely as the digital curation community reflects on two decades of progress while confronting emerging challenges related to AI, data quality, and changing demographics. This year’s conference was impressive by the numbers: 237 in-person attendees, plus 51 online participants, representing 50 countries across four continents. - [Key observations](#aioseo-key-observations) - [Personal Impressions](#aioseo-personal-impressions) - [Community feel](#aioseo-community-feel) - [Similar challenges](#aioseo-similar-challenges) - [Still tackling fundamentals](#aioseo-still-tackling-fundamentals) ## Key observations The most interesting session for me was [Martha Whitehead](https://provost.harvard.edu/people/martha-whitehead) and [Stuart Snydman](https://www.linkedin.com/in/snydman/)‘s presentation from Harvard University, titled, ‘From Building a First-Generation Digital Library Infrastructure to Reimagining Discovery.’ They focused on how digital infrastructure had developed over time at Harvard, evolving from the Library Digital Initiative in 1998 to today’s AI-enhanced discovery tools. What resonated most was their straightforward assessment of how the rapid increase and fragmentation of digital tools have created challenges for users. As Stuart put it: ‘We’ve accumulated an ecosystem of often bespoke, siloed, and specialized platforms that can at times feel overwhelming to the point of being counterproductive.’ This mirrors challenges I’ve seen across many organizations; as we use more tools to solve problems, we sometimes create new ones. Their demonstration of an [AI-powered Collections Explorer](https://news.harvard.edu/gazette/story/2025/03/at-harvard-library-building-a-tool-that-understands/) prototype showed how semantic search might transform the way researchers discover resources. Instead of just matching keywords, their system understands context and relationships between concepts, finding relevant materials even when specific search terms don’t appear in the metadata. Another standout was the presentation, ‘Managing Datasets in Their Afterlife’ by [Renata Curty from University of California, Santa Barbara](https://www.linkedin.com/in/renata-curty-17482325/). She tackled the often-overlooked topic of dataset retractions and how repositories handle compromised data. Her research found inconsistent approaches across platforms, highlighting the need for standardized practices in flagging and preserving retracted datasets rather than simply deleting them. #### Stay updated with Link Digital I agree to receive updates. Unsubscribe anytime. Subscribe ## Personal Impressions ### Community feel What I appreciated most about IDCC25 was its community feel. Despite growing to over 280 attendees, it has maintained an accessible atmosphere in which experienced professionals and newcomers could connect meaningfully. The conference’s hybrid format worked remarkably well for remote participants, like me, with dedicated online sessions in which it was possible to ask questions online and get real-time replies. It was possible to ask questions online and get real-time replies. ### Similar challenges I was impressed by how many institutions are tackling similar challenges with different approaches. Nearly every major university and research center seems to be wrestling with the same fundamental issues: fragmented infrastructure, limited user adoption, sustainable funding models, and the growing complexity of research data. Yet the different solutions they apply are influenced by unique priorities and constraints. The Belgium-based university [KU Leuven](https://www.kuleuven.be/english/kuleuven)‘s presentation on their integrated lifecycle of research data management tools was particularly interesting. They’ve created seamless connections between their data management planning tools, active data management system, and repository systems. What struck me was their pragmatic approach. Rather than building one monolithic system, they focused on creating strong connections between specialized tools. In contrast, Harvard has invested heavily in AI-powered discovery layers to help users navigate their ecosystem of tools, addressing the symptom rather than restructuring their underlying systems. The funding models also varied dramatically. While KU Leuven built their infrastructure with significant government co-financing, on the understanding they’d eventually need to demonstrate value or find alternative funding, other institutions like UC Santa Barbara appeared to take a more step-by-step approach based on available grants and institutional priorities. This creates very different sustainability challenges. The Belgian approach offers a more comprehensive initial buildout but faces a potential funding cutout. While this approach may be more sustainable it can create integration headaches. Another observation I would make is that institutions with strong central IT governance seemed to make faster progress than those with more distributed decision-making. As one speaker from a Dutch university noted, ‘Sometimes the hardest part isn’t building the technology but getting all the stakeholders to agree on what we’re building in the first place.’ ### Still tackling fundamentals The conference reinforced that while there’s been solid progress in digital curation over two decades, we’re still grappling with fundamental challenges around sustainability, interoperability, and user experience. ‘We’ve solved many technical problems but still struggle with the human ones,’ one presenter noted. As I think through how to apply these insights at Link Digital, I’m especially focused on how we can better integrate our tools while keeping user needs central to our design process. IDCC25 was an informative, timely reminder that behind every data point and digital asset are people trying to discover, understand, and build knowledge. - [Facebook](https://www.facebook.com/LinkDigital%20) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/%20) **Categories:** CKAN, Higher Education/Research, Industry, Internal data hub, Open Data, Technology Infrastructure --- ### [What is the true value of open source software? It depends on what you’re measuring](https://linkdigital.com.au/news/2025/03/what-is-the-true-value-of-open-source-software-it-depends-on-what-youre-measuring/) **Published:** March 19, 2025 **Author:** Andrew Nette **Content:** Link Digital utilises many OSS components in its day-to-day work designing, building and servicing open and internal data portals and catalogues. This includes CKAN – [the Comprehensive Knowledge Archive Network](https://ckan.org/) – an open source software with a global reputation for building management solutions, and [Drupal](https://new.drupal.org/home), a powerful open source content management software platform. We recommend open source technology solutions because of their flexibility, adaptability, and reliability. Software such as CKAN enables our clients to avoid license fees and vendor lock-in. This is one type of demonstrable ‘value’ that open source can deliver to clients. A related concept of value is the subject of a [very recent working paper by researchers at the Harvard School of Business and the University of Toronto](https://www.hbs.edu/faculty/Pages/item.aspx?num=65230), which sought to put a dollar figure on what the OSS market is worth to the private sector globally. Let’s examine the Harvard study in the context of some of the broader debates around the ‘value’ of OSS, particularly in relation to CKAN and the global community of users around it. ## Table of contents - [The inexorable growth of open source technology](#aioseo-the-inexorable-growth-of-open-source-technology) - [Private sector support for open source: size does matter](#aioseo-private-sector-support-for-open-source-size-does-matter) - [More than one definition of value](#aioseo-more-than-one-definition-of-value) ![the value of open source](https://linkdigital.com.au/wp-content/uploads/2025/03/What-is-the-value-of-open-source-software-1024x535.png)## The inexorable growth of open source technology OSS has a source code that anyone can inspect, modify, and enhance. This is as opposed to proprietary software, for which the source code is exclusively controlled by the person, team or organisation that created it, and only they can inspect or modify it. There is no doubt open source is a rapidly growing share of the global software market. To cite [a January 2025 report by one business research company](https://www.thebusinessresearchcompany.com/report/open-source-software-global-market-report), OSS’s market size is estimated to have grown from $US41.83 billion in 2024 to $US48.92 billion in 2025 alone, a development that is expected to continue The report also noted a trend in what are known as permissive open source licences, that impose minimal restrictions on software users, allowing them to incorporate OSS into proprietorial applications. It’s worth briefly recapping some of the key reasons underlining this growth. The COVID pandemic, coupled with a more challenging policy environment generally, has seen governments, businesses and not for profits collect more data than ever before. With this has come the need for innovative and flexible solutions to organise, share and make sense of the data. The January 2025 report notes that a growing proportion of private sector users, including smaller enterprises, are attracted to OSS for its cost effectiveness and flexibility. OSS also has a growing reputation for security. These observations very much align with Link Digital’s experience, particularly in relation to CKAN and its growing use in open data initiatives. Sophisticated OSS that can be configured and set up to function as an open or internal data platform once it is deployed and hosted on a web server, [CKAN now serves as a key component in some of the largest and most successful data portals around globally](https://civicdataecosystem.org/2023/06/19/analysis.html). > **Without open source software and their ubiquitous code-creation networks, firms would pay an estimated 3.5 times more to build the software and platforms that run their businesses, or roughly $8.8 trillion.** > > The Value of Open Source Software, Harvard Business School Faculty & Research According to the Harvard study, past attempts to measure the global value of OSS have proven difficult due to its non-pecuniary nature and the lack of centralised usage tracking data. [Those interested can consult the Harvard paper for their full methodology](https://www.hbs.edu/faculty/Pages/item.aspx?num=65230). In short, the researchers relied on innovative data sources to calculate OSS’s share of the on-line technology being used by firms globally, and the replacement cost to firms that currently use open source software, if this technology did not exist and they had to replicate it themselves. The study calculates the supply-side value of most widely used open source software is $US4.15 billion. But ‘without open source software and their ubiquitous code-creation networks, firms would pay an estimated 3.5 times more to build the software and platforms that run their businesses, or roughly $8.8 trillion.’ ## Private sector support for open source: size does matter The Harvard study is oriented towards a business audience for whom numbers and metrics are a key indicator and appears only to cover private sector usage of OSS. This means, if anything, it could be underestimating open source’s overall economic contribution. The study is certainly an important contribution to understanding the growing importance of OSS. And putting numbers on its economic impact could serve to highlight actions that governments and the private sector could take to better support the open source ecosystem. As the authors put it, their study will ‘ideally add weight to arguments that users of OSS should not just free ride but also contribute to the creation and maintenance of OSS.’ Noting that such a contribution would still be a fraction ‘a fraction of the costs to firms if OSS did not exist.’ This last sentiment has been echoed [in recent research by another market analyst](https://www.metastatinsight.com/report/open-source-software-market), which asserts there is ‘an ongoing concern regarding whether critical \[open source\] software is receiving adequate, sustained attention and development resources, which stakeholders need to address. Organizations who are using such solutions are realizing now that with the direct contribution, sponsorships, and developers’ support for key projects, they can ensure they will be robust and reliable.’ This is an argument which [Adrià Mercader](https://www.linkedin.com/in/adriamercader/?originalSubdomain=es), Link Digital’s Senior Solutions Architect and a long-term contributor in the open source community, is uncertain about. ‘I’m not sure that a value-generating focused organisation like a standard company will see these macro-economic figures and decide they need to do their part. It is much more cost effective to take something for free and use it rather than invest resources trying to help maintain it.’ Mercader believes the issue of encouraging the private sector to contribute to OSS might best be viewed in the context of both the size of the company concerned and the OSS product they are using. ‘For a small to medium company, if they are using a very popular and well-established open source project (i.e., [Postgres](https://www.postgresql.org/), [Python](https://www.python.org/), [nginx](https://nginx.org/en/), [Kubernetes](https://kubernetes.io/), etc), they are probably not going to make a difference by trying to contribute and they are going to be fine relying on it down the line (although they should if they are willing!). But if it’s a massive company relying on one or more open source products for their critical processes, then it starts to make sense to ensure that the project is healthy.’ ‘Conversely, if a small to medium sized company is relying on a smaller open source product, like CKAN, then it makes a lot more sense for them to be involved to mitigate the risk of the project not progressing. Also, companies will rely on many different open source products, so it makes sense to be strategic about the ones to support.’ [As noted on this popular post on the Link Digital site from November 2024](https://linkdigital.com.au/news/2024/11/expanding-the-reach-and-building-connections-lessons-from-the-ckan-project/), co-authored by Mercader, it is important to stress there are many ways, apart from direct financial assistance, that the private sector contributes to OSS projects; everything from occasional patches and features sent by developers working on commercial projects to funding people to work on maintenance. A significant proportion of the CKAN tech team, for example, are linked to private sector vendors, and both CKAN co-stewards are from the private sector. ## More than one definition of value When it comes to OSS, it is also important to recognise value as more than just private sector return. In the case of CKAN, for example, one of the guiding principles is open data is a public good that should be non-right restricted and easily transferable, and that creates more value the more it is shared. CKAN enables researchers, not for profits, government policy makers, and business, to better catalogue, discover, and use data to formulate responses to complex challenges. It can also support collaboration across institutional and geographic divides, improve transparency in relation to the use of data, and make decision makers more accountable. Importantly, OSS such as CKAN can also act as a sustainable digital public good and open data infrastructure for countries and grassroots civil society movements who may lack the means to establish and maintain one on their own. It can create digital platforms on which any government, donor, academic, or member of the community can both store and access high quality and reliable data to guide decision making and action. Further, as the November 2024 piece on our site cited above stated, while private sector involvement in OSS can bring definite benefits, it can also pose risks and challenges. The private sector sometimes has needs and goals that might not completely align with the OSS technology concerned. In the case of CKAN, it is important that the ‘original goals in terms of intended audience and use cases, and the required level of skill to use the software, are maintained… It is important that the novel points of view or practices mentioned previously don’t leave a section of the CKAN community behind, i.e., by increasing the onboarding period due to more complexity or increasing the out of the box costs of using software.’ In summary, when talking about the value of OSS, it is not just a matter of what value the private sector is getting from the software. We also need to address the issue of value in terms of what the OSS community might be getting from private sector involvement. ‘I come to OSS from a different set of values,’ states Mercader. ‘I’m more interested in freedom of choice and modification, avoiding lock-in, reusing approaches etc. Looking at open source contributions purely in economic terms might be beneficial in contexts where this is the main driving force, but we need to be mindful of the risk that then the discussion around OSS contributions becomes framed purely in economic, profit driven terms. This is important but it can’t become the main driving force.’ ## Want to build a CKAN-based open or internal data portal? [Contact us](https://linkdigital.com.au/get-in-touch/) and one of our data experts will be in touch. - [LinkedIn](https://www.linkedin.com/company/link-digital/%20) - [YouTube](https://%20https://www.youtube.com/@link-digital) - [Facebook](https://www.facebook.com/LinkDigital%20) **Categories:** All articles, CKAN, Government, Higher Education/Research, Open Data **Tags:** CKAN, Harvard School of Business, open source software --- ### [CKAN Extensions: using the CKAN plugins toolkit](https://linkdigital.com.au/news/2024/06/using-the-ckan-plugins-toolkit/) **Published:** June 11, 2024 **Author:** Brett Jones **Excerpt:** This toolkit provides a structured way to develop plugins that can enhance the core behaviour, extend the data model, add new features, or integrate CKAN with other systems. **Content:** The CKAN Plugins Toolkit is a powerful framework that allows developers to extend and customise the functionality of CKAN. This toolkit provides a structured way to develop plugins that can enhance the core behaviour, extend the data model, add new features, or integrate CKAN with other systems. CKAN plugins are in effect Python packages that implement specific interfaces defined by the CKAN core. ## **Here’s an overview of how to use the CKAN Plugins Toolkit:** ### **Key Concepts and Components** 1. **Plugin Interfaces**: - **IConfigurer**: Allows customization of the CKAN configuration. It is used to modify the configuration object, templates, public assets, etc. - **IMapper**: Extends or modifies the database schema and mapping. - **IRoutes**: Adds new routes and controllers to handle custom pages and actions. - **ITemplateHelpers**: Provides custom template helper functions that can be used in Jinja2 templates. - **IAuthFunctions**: Customises authorization logic. - **IActions**: Defines new actions that can be exposed via the API. 2. **Plugin Class**: - Each plugin is a Python class that inherits from the **ckan.plugins.SingletonPlugin** and implements one or more interfaces. 3. **Entry Points**: - Plugins are registered in the CKAN setup using entry points defined in the setup.py file of the plugin package. In my example I will alter the **IAuthFunctions** interface. ## **Overview of IAuthFunctions** The IAuthFunctions interface is used to define custom authorization logic for different actions within CKAN. By implementing this interface, developers can specify who has permission to perform various actions, such as creating datasets, editing resources, or managing organisations and groups. ### **Key Points of IAuthFunctions** 1. **Interface Definition**: - IAuthFunctions is defined in the ckan.plugins.interfaces module. - It provides a set of methods that plugins can implement to control access. 2. **Core Methods**: - The primary method in IAuthFunctions is get\_auth\_functions, which returns a dictionary mapping action names to authorization functions. 3. **Authorization Functions**: - An authorization function checks whether a user is authorised to perform a specific action. - These functions typically return a dictionary with the key ‘success’ set to True or False, indicating whether the action is allowed. If ‘success’ is False, an optional ‘msg’ key can provide an error message explaining why the action is not permitted. 4. **Custom Authorization Logic**: - By implementing IAuthFunctions, developers can define custom rules for various actions. - This is useful for scenarios where the default CKAN authorization rules do not meet specific requirements. For this example we will create a new CKAN group called “pigeons” and if you are a member of the “pigeons” group you can add a new group. If you are not an admin user or a member of “pigeons” you cannot add a new group In the plugin.py file we uncheck the following interfaces: ![](https://linkdigital.com.au/wp-content/uploads/2024/06/image.png) As we can see below the **get\_auth\_functions()** method overrides the default **group\_create()** function with a custom one. This custom function gets the name of the logged in user, the list of all members of the “pigeon” group and checks to see if the logged in user is a member of this group. It returns “True” if it is and “False” if it is not. If the user is a member of the pigeon group it will then have the ability to “Add a new CKAN group ![](https://lh7-us.googleusercontent.com/docsz/AD_4nXdkHMtcISadIgHgdLHz767FiK6Qp9mYxJVBBYDcHZOJtA-HwfloZqOaXQj-N2xnwzJjJGMZf3F3nwkVlFkF9gjyN4UazZIRynw3RbZM_V9kVVOocZF-ggq32O2bOUJXe-RsTDSyvXlPJEn0JpCDCbWZZPE?key=fjYqZbFN2HmE9Nc0TXg8oQ) Below we see within the “My Groups” tab the logged in user is a member of the “pigeons” group as I have the “Add Group” button on the screen. If the logged in user was not in the pigeons group it would not have this button on the screen ![](https://linkdigital.com.au/wp-content/uploads/2024/06/image-2.png) That’s it! You can also watch the [12-minute video](https://www.youtube.com/watch?v=5PNX0PXzWAc&list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx&index=2&t=83s&pp=gAQBiAQB) version of this tutorial on the Link Digital [YouTube channel](https://www.youtube.com/@link-digital). --- **Related articles** [How to install CKAN using Docker Containers](https://linkdigital.com.au/news/2024/04/how-to-install-ckan-using-docker-containers/) [How to install DataStore and DataPusher on CKAN](https://linkdigital.com.au/news/2024/05/how-to-install-datastore-and-datapusher-on-ckan/) [Create a CKAN development environment and install a new extension](https://linkdigital.com.au/news/2024/05/create-a-new-ckan-development-environment-and-install-a-new-extension/) [Introduction to updating CKAN templates](https://linkdigital.com.au/news/2024/05/introduction-to-updating-ckan-templates/) **Categories:** All articles, CKAN, Resources, Tutorial **Tags:** CKAN --- ### [How to install DataStore and DataPusher on CKAN](https://linkdigital.com.au/news/2024/05/how-to-install-datastore-and-datapusher-on-ckan/) **Published:** May 7, 2024 **Author:** Brett Jones **Content:** This article shows you the step-by-step for installing the most common CKAN extensions that people like to get running, DataStore and DataPusher. ## **CKAN Datastore** The CKAN DataStore extension is a database solution tailored for structured (tabular) data derived from CKAN resources. It facilitates the extraction of data from resource files and its subsequent storage within the DataStore. The DataStore database stores data in tabular format, making it suitable for structured datasets such as spreadsheets, CSV’s, JSON, XML and even Database tables. Upon uploading of a data resource into the DataStore, users benefit from: - Automated data previews: Accessible directly from the resource’s page, leveraging functionalities such as the DataTables view extension. - Utilisation of the Data API: streamlined search, filtering, and updating of data without necessitating the complete download and upload of the data file. - Seamless integration of the DataStore into the CKAN API and its accompanying authorization framework. Typically employed in conjunction with the DataPusher, the DataStore extension seamlessly accommodates the automated uploading of data from compatible files, whether sourced from local files or external links. The documentation for installing DataStore is located here: . ## **DataStore Installation** In the instructions before we set a database user called **datastore\_default** and then creates the datastore database called **datastore\_default** using the **ckan\_default** user to create the database: **sudo -u postgres createuser -S -D -R -P -l datastore\_default** **sudo -u postgres createdb -O ckan\_default datastore\_default -E utf-8** Now the CKAN configuration file (ckan.ini) should be updated to the password that was applied when creating the **datastore\_default** user **ckan.datastore.write\_url = \\ postgresql://ckan\_default:pass@localhost/datastore\_default** **ckan.datastore.read\_url = \\ postgresql://datastore\_default:pass@localhost/datastore\_default** It then applies permissions using the **datastore** cli command: **ckan -c /etc/ckan/default/ckan.ini datastore set-permissions | sudo -u postgres psql –set ON\_ERROR\_STOP=1** This should now be tested using an API command: **datastore\_search?resource\_id=\_table\_metadata.** If there are no errors when running this command then installation has been successfully completed. **curl -X GET \\ “http://127.0.0.1:5000/api/3/action/datastore\_search?resource\_id=\_table\_metadata”** ![](https://linkdigital.com.au/wp-content/uploads/2024/05/imge-datastore-installation-1024x815.jpg)**Fig 1:** Simplified view of the database connections from the CKAN server and the DataPusher uWSGI server to the CKAN and DataStore databases ## **CKAN Datapusher** The DataPusher is another CKAN extension and is a crucial component in the CKAN ecosystem, designed to streamline the process of pushing data into the CKAN DataStore database. The DataPusher serves as a bridge between external data sources and a CKAN instance, facilitating the seamless integration of datasets into the CKAN platform. Its primary function is to automate the process of uploading and updating datasets in CKAN, ensuring that the data available in CKAN remains current and accurate. ## **Key features of the CKAN DataPusher include:** 1. Automated data upload: The DataPusher automates the process of uploading datasets to CKAN, eliminating the need for manual intervention. 2. Real-time data synchronisation: The DataPusher enables real-time synchronisation of data between external sources and CKAN, ensuring that changes made to datasets are promptly reflected in the CKAN instance. 3. Data validation: The DataPusher validates the data before uploading it to CKAN, ensuring its integrity and consistency. 4. Metadata extraction: The DataPusher extracts metadata from the datasets and maps it to CKAN’s metadata schema, making the datasets more discoverable and accessible within the CKAN platform. 5. Support for various data formats: The DataPusher supports a wide range of data formats, including CSV, Excel, JSON, and others, making it versatile and adaptable to different data sources. 6. Scalability: It is designed to handle large volumes of data efficiently, ensuring optimal performance even when dealing with extensive datasets. Overall, the CKAN DataPusher simplifies the process of managing and updating datasets in CKAN, enabling organisations to make their data more accessible and actionable for users. ## **DataPusher Installation** Here are the instructions for installing a “development” DataPusher on an Ubuntu Server We first install the system libraries. These libraries may have already been installed if you have CKAN up and running: **sudo apt-get install python-dev python-virtualenv build-essential \\ libxslt1-dev libxml2-dev zlib1g-dev git libffi-dev** We then need to clone (download) the DataPusher software: **git clone https://github.com/ckan/datapusher** **cd datapusher** Next, we need to install the library dependencies: **pip install -r requirements.txt** **pip install -r requirements-dev.txt** And finally we install the actual DataPusher software: **pip install -e .** We can run DataPusher in “development mode” using the following command: **python datapusher/main.py deployment/datapusher\_settings.py And we can then access DataPusher with the following URL: **http://localhost:8800/ The DataPusher is also included as a separate Docker Compose service in the official CKAN Docker installation. ## **The Future of DataPusher** Recent efforts have been dedicated to two analogous projects, XLoader and DataPusher+. It is anticipated that in the foreseeable future, both XLoader and DataPusher+ will supersede DataPusher as the primary mechanisms for uploading and updating structured datasets within the CKAN ecosystem. **Related video:** [**Install DataPusher and DataStore | CKAN 2.10 | Ubuntu**](https://www.youtube.com/watch?v=Dz_XTrSvN-E) --- **About [Brett Jones](https://www.linkedin.com/in/brett-jones-49369b8/)** *With a 30-year tenure in the tech industry, Brett Jones brings a wealth of experience across the globe. His career has traversed six international cities: Wellington, Sydney, Melbourne, New York, San Francisco, and Berlin, with an additional stop in Dhahran, Saudi Arabia. Throughout his journey, he has donned various hats at three tech giants – BEA Systems, Sun Microsystems, and Hewlett Packard. His expertise spans across diverse roles, including developer, solution architect/design, systems engineering, DevOps, and integration.* *Highlights of Brett’s impressive career include working on the trading floor at 60 Wall Street during the dot-com boom, experiencing the heart of Silicon Valley, and dedicating the last five years to the New Payments Platform (NPP) project in Sydney. His recent focus areas have been build automation, bespoke tool creation, application performance monitoring, and data engineering and analysis.* **Categories:** All articles, Resources, Tutorial --- ### [Link Digital supports Living Lakes Canada's 4th Annual National Lake Blitz](https://linkdigital.com.au/news/2024/04/link-digital-supports-living-lakes-canadas-4th-annual-national-lake-blitz/) **Published:** April 12, 2024 **Author:** Kate Sampher **Content:** ## **About National Lake Blitz and its mission** The National Lake Blitz invites volunteers to monitor lakes across Canada from May to September. The mission is to gather temperature readings, snap shoreline photos, record water color, and contribute to a greater understanding of aquatic ecosystems. All data is added to the[ ](https://livinglakescan.maps.arcgis.com/apps/instant/sidebar/index.html?appid=7e840c7135dc475bbe5fd91571e814c8)[Lake Blitz Observation Map](https://livinglakescan.maps.arcgis.com/apps/instant/sidebar/index.html?appid=7e840c7135dc475bbe5fd91571e814c8). The data is also made available on two open access online platforms for sharing fresh water data: the [Columbia Basin Water Hub](https://data.cbwaterhub.ca/), the official home for Lake Blitz data, and [Datastream](https://datastream.org/en-ca/). No prior experience is necessary to join this entry level program. Whether you’re a seasoned naturalist or a curious kid, there’s a place for you within the National Lake Blitz. Living Lakes Canada provides diverse resources to help support volunteers, including [“how-to” videos](https://livinglakescanada.ca/our-programs/lakes/lake-blitz/videos/) for youth who want to get involved. After signing up, each volunteer receives a free standardized monitoring kit and online training. From data collection to entry, the training guides volunteers on how to monitor their chosen lake. ## **Why is this important?** The data collected through the National Lake Blitz enables a comprehensive picture of lake health across the country. This information can be used in developing conservation strategies and protecting these vital ecosystems. For those with interest in the visual, the Lake Blitz’s sister event, the[ ](https://livinglakescanada.ca/our-programs/lakes/lake-biodiversity-photo-challenge/)[Lake Biodiversity Photo Challenge](https://livinglakescanada.ca/our-programs/lakes/lake-biodiversity-photo-challenge/), might be for you. Running from June to July 2024, this contest encourages anyone, including Lake Blitz volunteers, to capture the stunning biodiversity of lakes and submit their photos for a chance to win prizes. ## **Join the Lake Blitz Summer Speaker Series** As part of the National Lake Blitz, Living Lakes Canada hosts a virtual [Summer Speaker Series.](https://livinglakescanada.ca/our-programs/lakes/lake-blitz/webinars/) These bite-sized talks are open to the public and provide opportunities to learn and network with other volunteers, lake stewards and environmental leaders across Canada. A diverse panel of experts, artists, storytellers, and researchers from Canada will dive into their unique perspectives on lake ecosystems and climate change impacts, and share their experiences and expertise. \_\_\_ **Want to explore the Columbia Basin Water Hub further?** If you are interested in discovering more about the Columbia Basin Water Hub, you can[ ](https://linkdigital.com.au/project/columbia-basin-water-hub/)[read this case study](https://linkdigital.com.au/project/columbia-basin-water-hub/) to learn about its technical aspects and the benefits of open access databases. You can also go to this video to[ watch the presentation by Maggie Finkle-Aucoin](https://youtu.be/IVcSgeI_Z_E?si=EZNwsCWAb_qXRFb6&t=96), GIS and Database Manager with Living Lakes Canada, from our monthly forum in November 2023. **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Kate Sampher, Open Data, Thought Leadership **Tags:** CKAN, partnership, Thought Leadership --- ### [Link Digital releases further CKAN instructional videos](https://linkdigital.com.au/news/2024/02/link-digital-releases-further-ckan-instructional-videos/) **Published:** February 28, 2024 **Author:** Andrew Nette **Content:** Additional [Comprehensive Knowledge Archive Network (](https://ckan.org/)CKAN)-related video tutorials by one of [Link Digital’s](https://linkdigital.com.au/) global team of CKAN experts, Sergey Motornyuk, have been uploaded to our [YouTube channel](https://www.youtube.com/@link-digital). One of the main open source technological solutions we use to build data management systems, CKAN is what [Link Digital](https://linkdigital.com.au/) refer to as out-of-the-box software, that is it can work immediately once it is deployed and hosted on a web server. But it also comes with a wealth of extensions and plugins that can significantly increase its functionality. And, as a [CKAN ‘co-steward’](https://linkdigital.com.au/news/2019/08/co-stewarding-of-the-ckan-project-is-about-delivering-results-rewards-and-recognition/) and one of its largest contributing developers, we are keen to assist CKAN’s users and contributors to get the most from these. ## A further ten videos have been uploaded, covering the following topics: [The fundamentals of HyperText Markup Language (HTML)](https://www.youtube.com/watch?v=N8ebmVCzMrE): the standard markup language used to create and design web pages. [Leaning Cascading Style Sheets or CSS](https://www.youtube.com/watch?v=AXSVqB0EE5Y): the language used for describing the presentation and layout of HTML documents, which allows web developers to control the appearance of web pages. [Boosting your skills in Linux Terminal](https://www.youtube.com/watch?v=qcc20w8fHq0): a text-based interface used to interact with the [Linux](https://www.linux.org/) open source operating system. [Docker, Git, and container management in Linux](https://www.youtube.com/watch?v=mInO5pyfA7k): an introduction to [Docker](https://www.docker.com/), an open source platform that allows developers to develop, deploy, and run applications using containers. Sergey also discusses [Git](https://git-scm.com/), a version control system that can track changes in source code during software development and enables multiple developers to collaborate on the same project simultaneously. [An introduction to Flask](https://www.youtube.com/watch?v=_B6kFdD4VEg): a web framework for the widely used programming language, [Python](https://www.python.org/). [An introduction to JavaScript](https://www.youtube.com/watch?v=AzDuG1Gp3NU): a programming language mainly used for creating interactive web pages. [Exploring Web JavaScript](https://www.youtube.com/watch?v=AzDuG1Gp3NU): the use of JavaScript in web development, particularly in the creation of interactive features in web pages. [Exploring Docker and SQL](https://www.youtube.com/watch?v=gaRAtNxJ5R8): the use of [Docker](https://www.docker.com/) for allowing for seamless container setup and management and SQL, a domain-specific language required for database operations. [An introduction to SQLAlchemy](https://www.youtube.com/watch?v=N9j_C_fHNxI), an open source tool kit that enables developers to interact with databases using [Python](https://www.python.org/), a free, widely used open-source programming language, explored in the first two of Sergey’s instructional videos, [here](https://www.youtube.com/watch?v=gBHbw8llRZ4) and [here](https://www.youtube.com/watch?v=COq9qRbZhso). [Developing a collaborative and flexible search system using the two open Solr and Redis](https://www.youtube.com/watch?v=y1BYmigGMWg), two pieces of open source software that can enable search functionality in web applications. The videos are in Russian language but non-Russian speakers are able to listen to them by [utilising the Chrome Browser plugin called Language Reactor, available here](https://chrome.google.com/webstore/detail/language-reactor/hoombieeljmmljlkjmnheibnpciblicm). - Click on the ‘Add to Chrome’ button, - Then click on the ‘Add Extension’ button in the pop-up window. The plugin will then be added to the Chrome browser extensions and made available (and running) when viewing Sergey’s videos on YouTube. Other languages, apart from English, are also available. Further instructional videos by Sergey will be made available on [Link Digital’s](https://linkdigital.com.au/) YouTube in March. The videos represent one of the most comprehensive and detailed collections of CKAN instructional videos available on the Internet. They complement the [CKAN installation and walk-through videos already posted on our YouTube channel by another one of our CKAN developers, Brett Jones.](https://www.youtube.com/playlist?list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx) If you have found this post useful, you might be interested in taking part in a series of forums being held by [Link Digital](https://linkdigital.com.au/) on the last Thursday of every month, Australian EDT. These forums will connect you with like-minded experts who are passionate about the importance of open data and want to stay updated on the latest developments in the field. They are free to attend and open to everyone. [Register today](https://linkdigital.com.au/public-forum/?utm_source=google&utm_medium=blog&utm_campaign=public+forum). **Categories:** All articles, CKAN, Tutorial **Tags:** CKAN --- ### [New reports outline Australian Government’s directions in data and digital space](https://linkdigital.com.au/news/2024/01/new-reports-outline-australian-governments-directions-in-data-and-digital-space/) **Published:** January 17, 2024 **Author:** Andrew Nette **Content:** Two reports released at the end of 2023 outline the Australian Government’s policy directions in the data and digital space, and the linkages it intends to create between making data more open and shareable and issues such as improved service provision and encouraging more effective and participatory forms of governance: the final version of the [*Data and Digital Government Strategy: The data and digital vision for a world-class APS to 2030*](https://www.dataanddigital.gov.au/plan); and the [*Third Open Government Partnership National Action Plan, 2024-2025*](https://www.ag.gov.au/integrity/australias-open-government-partnership/australias-third-national-action-plan), developed as part of the Australian Government’s obligations as a member of the [Open Government Partnership](https://www.opengovpartnership.org/) (OGP). The *Data and Digital Government Strategy* follows the same structure as the draft version released for consultation in mid-2023, outlining five ‘missions’ and steps to achieve them. - Using ‘data and digital technologies to deliver connected, accessible services centred around the needs of people and business.’ The document seeks to maximise the value from data and data sharing, with appropriate safeguards to ensure privacy. It also requires ‘all government entities to make non-sensitive data open by default in compliance with relevant laws and appropriate privacy, security and ethical controls for sharing sensitive data.’ - Stipulating a ‘digital by design’ focus for the APS (Australian Public Service), that will see it work as ‘a single, unified enterprise,’ using ‘technology, data and analytics to deliver simple, accessible services for people and business.’ - Harnessing the opportunities presented by new technologies such as generative AI and quantum computing, while actively monitoring and managing the potential risks. - Partnering ‘with people and business to make decisions and deliver trusted, transparent and ethical services and support people’s choices when engaging with public services.’ This includes creating ‘robust privacy and security settings and a culture of integrity and accountability will give people and business confidence their data is safe.’ - Building a data and digitally capable APS. ## **Positives in the *Data and Digital Government Strategy*** Informed by the consultation process, which included [Link Digital](https://linkdigital.com.au/), the *Data and Digital Government Strategy* is obviously more thought out and detailed than the draft. It shows a government that wants to be on the front foot in terms of data and digital positioning and sets out a comprehensive schedule of associated reform activities. These include a review of the 2021 [Intergovernmental Agreement on Data Sharing](https://www.finance.gov.au/government/public-data/data-and-digital-ministers-meeting/intergovernmental-agreement-data-sharing), which commits all jurisdictions to share public sector data as a default position and the principles by which this should be done. There is a commitment to develop an Australian National Data Integration Infrastructure in collaboration with the states and territories to support data sharing, integration, and national linkage for the [National Disability Data Asset](https://www.ndda.gov.au/). There will be periodic reviews of the [*Data Availability and Transparency Act* 2022](https://www.datacommissioner.gov.au/law/dat-act) governing the [DATA Scheme](https://www.datacommissioner.gov.au/the-data-scheme), the framework for sharing of data from all Australian Government entities save those excluded on national security grounds. Connections are also made to the relevant findings of recent reviews of the *Privacy Act 1988,* the [Royal Commission into the Robodebt Scheme](https://robodebt.royalcommission.gov.au/), the 2023 [myGov User Audit](https://my.gov.au/en/audit), and the [recent inquiry into the role of the National Archives in the protection, preservation and use of Commonwealth information](https://www.naa.gov.au/about-us/tune-review). The final document contains a greater focus on government seeking out partnerships with the private sector, academics, and community sectors on co-design solutions. This includes working with the private sector on data sharing, greater engagement with state and territory governments, and ‘engaging with industry and global experts to stay informed of the latest tools, technologies and methodologies in data and digital capability development.’ There is also an explicit commitment to engage with the OGP to promote accountability using data and digital technologies. There is a more fleshed out conception of the ‘tell us once’ approach to organise and tailor services to individuals’ circumstances, centred on a nationally consistent approach to a secure opt in Digital ID for individuals. While many details need to be worked out, this would potentially make it easier for government’s and third party organisations to prove people’s identities, in other words to provide verifiable claims to citizens based on a minimum of personal data, while protecting people from threats such as identity theft. [Link Digital](https://linkdigital.com.au/) was particularly happy to see the important lessons of the [Royal Commission into the Robodebt Scheme](https://robodebt.royalcommission.gov.au/) cited at several points in the document, particularly in relation to the design of these systems and the need for greater oversight of automated decision making and data-matching programs. In our comments on the draft, [Link Digital](https://linkdigital.com.au/) argued for a greater emphasis to be placed on how the APS’s data and digital transformation can help counter broader societal threats such as the spread of deliberate disinformation and contribute to the creation of more resilient public institutions. This disinformation threat appears to be covered off in the draft *Communications Legislation Amendment (Combatting Misinformation and Disinformation) Bill 2023* currently before federal parliament. The *Data and Digital Government Strategy*’s threat focus centres on how to build trust in government services, especially related to the handling of personal information, improved cyber security against the activities of ‘malicious state and non-state actors,’ and the potential dangers from emerging technologies such as AI. An explicit link is made to the new [*2023-2030 Australian Cyber Security Strategy*](https://www.homeaffairs.gov.au/about-us/our-portfolios/cyber-security/strategy/2023-2030-australian-cyber-security-strategy) which focuses on strengthening the capacity of individuals and small and medium sized businesses to deal with cyber-attacks and the protection of critical infrastructure. The *Australian Cyber Security Strategy* is accompanied by a national Cyber Security Uplift Plan ‘which will drive a strategic and pragmatic approach to enhancing collective cyber resilience, building capabilities and lifting cyber security to help Australian people and business with cyber incidents.’ ## **Missed opportunities** Although we welcome the emphasis on external partnerships and the commitment to increase data and digital literacy across the APS, [Link Digital](https://linkdigital.com.au/) believes this area of the strategy represents a lost opportunity by not explicitly mentioning the open source community as a source of much needed skills and knowledge. The document remains largely focused on a centralised in-house model of workforce development for the APS, closing it off from the benefits that would directly flow from broader collaborations with groups like the open source community, including exposure to new talent and new skills, ideas and partnerships. This is especially an issue given Government is competing with the private sector for a limited talent pool of data literate recruits. More seriously, [version 2.0 of the Digital Transformation Agency’s Digital Service Standards](https://architecture.digital.gov.au/digital-service-standard-v2-guides-and-tools-full-text) – recommended principles government agencies should adopt when creating digital services – released in December 2023, completely omits [version 1.0’s](https://architecture.digital.gov.au/digital-service-standard-v1-full-text) mention of open source by default in favour of a vague commitment to open data and standards. This could complicate the core commitment in the *Data and Digital Government Strategy* to using ‘technology, data and analytics to deliver simple, accessible services for people and business.’ Another concern arises from aspects of the [Metrics Framework](https://www.dataanddigital.gov.au/sites/default/files/2023-12/Data%20and%20Digital%20Metrics%20Framework%20v1.0.pdf) that accompanies the *Data and Digital Government Strategy*. One stated metric in relation to delivering for people and businesses is ‘# of data assets discoverable and available for use’. While this was certainly an early metric adopted by the open data movement, it has fallen out of favour for being highly malleable and ignoring important issues such as data quality. This is something picked up in recent studies, including work by Pavel Krasikov and Christine Legner,[\[1\]](#_ftn1) and the ninth edition of the [2023 Open Data Maturity Report](https://data.europa.eu/en/news-events/news/2023-open-data-maturity-report-has-been-released) conducted by [data.europa.eu](https://data.europa.eu/en). The latter outlines other indicators relevant to evaluating the performance of countries in making public sector information available and encouraging its re-use. Another problematic metric used by the Australian Government is ‘% of people who trust public services.’ [Link Digital](https://linkdigital.com.au/) would suggest the concept of ‘trust’ is highly subjective and that a more relevant question is how to measure steps taken to improve the trustworthiness of systems.[\[2\]](#_ftn2) [The metrics used by Open Data Institute](https://theodi.org/insights/explainers/odi-data-strategy/) (ODI) to measure delivery of their data principles are useful here. One indicator deals with whether ODI data and data principles are trustworthy, and states: ‘We will govern data in ways that ensure compliance with legal and societal norms, and reduce the risk of harmful impacts to individuals and communities. We understand the provenance and quality of the data we collect, use and share and communicate its suitability for purpose.’ ## **Australia re-engages in the OGP** The OGP was founded in 2011 as a partnership of government leaders and civil society groups working to promote transparent, participatory, and accountable governance. Government members are required to develop National Action Plans (NAP) outlining concrete steps towards open government, through a multi-stakeholder process that actively engages citizens and civil society. While [Link Digital](https://linkdigital.com.au/) may have hoped for a slightly more ambitious document, the *Third* *Open Government Partnership National Action Plan 2024–2025* signals the Government’s thoughtful re-engagement with the OGP. Australia’s second plan was delivered late and the deadline for the third missed altogether, jeopardising Australia’s continued membership. The NAP contains eight commitments, several of which link to data and digital*.* The NAP commits to increase transparency around the use of automated decision making and AI, including the development of a consistent legal framework for government agencies and enhanced protections for personal information handling by entities subject to the *Privacy Act 1988*. Another commitment is the development of an ‘Integrity Strategy for the Australian Public Service’. This builds on the current Government’s agenda of strengthening integrity across the APS, particularly in the wake of the [Report of the Royal Commission into the Robodebt Scheme](https://robodebt.royalcommission.gov.au/). Two commitments focus on processes already underway to make government and private sector data more open. These include beneficial ownership reform and making political financing more transparent. Flowing from [a government consultation process in 2022](https://treasury.gov.au/consultation/c2022-322265), beneficial ownership reforms would introduce requirements ‘for companies to record information about who ultimately owns, controls and receives benefits from a company operating in Australia’…‘This commitment ensures that adequate, accurate and up-to-date information on beneficial ownership and control is available in a timely manner to relevant authorities and the public. This information will increase corporate accountability, and help to address and prevent tax evasion, money laundering, terrorism financing, and corruption.’ Amending national political donations laws was the subject of a federal parliamentary committee inquiry into the 2022 federal election. This recommended, amongst other measures, lower donation disclosure thresholds and expediting the reporting of donations. These changes would add to data on the public record that could then be used to independently verify claims made by political interests, [of the sort discussed in this article on our site in November](https://linkdigital.com.au/news/2023/11/countering-large-scale-disinformation-campaigns-in-election-contexts-is-there-a-role-for-open-data-in-the-fight/). The article discussed overseas initiatives involving the creation of online portals that take publicly available datasets, including political donation and lobby registers, etc, and make it easily searchable. Picking up on concerns about online-disinformation, the NAP also commits to improve media literacy in culturally and linguistically diverse communities, including to counter the impacts of mis-and dis-information. Topics like the one in this post are discussed in a series of forums being held by [Link Digital](https://linkdigital.com.au/) on the last Thursday of every month, Australian EDT. These forums will connect you with like-minded experts who are passionate about the importance of open data and want to stay updated on the latest developments in the field. They are free to attend and open to everyone. [Register today](https://linkdigital.com.au/public-forum/?utm_source=google&utm_medium=blog&utm_campaign=public+forum). --- [\[1\]](#_ftnref1) Krasikov, Pavel, and Christine Legner. “A Method to Screen, Assess, and Prepare Open Data for Use.” *ACM Journal of Data and Information* 15, no. 4, Article 43. October 2023. In particular, see table 10, which summarises existing open data considerations in terms of design considerations. [\[2\]](#_ftnref2) This issue was discussed by [Link Digital](https://linkdigital.com.au/) Chair [Steven De Costa](https://www.linkedin.com/in/stevendecosta/?originalSubdomain=au) in [a November 2023 keynote on ‘The Architecture of Trust: Open and Honest Data,’](https://www.youtube.com/watch?app=desktop&v=g8JIaVVTLn4) to the [Canadian Open Data Society](https://www.opendatasociety.ca/)’s Summit. **Categories:** All articles, Government, Open Data **Tags:** digital government, open data --- ### [Six highlights that shaped Link Digital in 2023](https://linkdigital.com.au/news/2023/12/six-highlights-that-shaped-link-digital-in-2023/) **Published:** December 20, 2023 **Author:** Andrew Nette **Content:** It is a cliché to say that any year is more important than another in the life of a company. The last twelve months have been busy for [Link Digital](https://linkdigital.com.au/), with new staff, new projects, and the opening of a new office. This is business as usual since the company was founded as Link Web Services at the end of the dot-com bubble in 2001 and renamed Link Digital in 2004. What we can say, however, is that 2023 has seen a significant development in our work as a digital agency operating at the intersection of open data and open source technology. This is not just about what [Link Digital](https://linkdigital.com.au/) has done. It is about the events we have organised and taken part in, and the networks, and communities we continue to work with in Australia and internationally. Here are six things that we think made 2023 a particularly exciting and noteworthy year. ## **Our work for clients** At the heart of [Link Digital](https://linkdigital.com.au/), our commitment is to provide high-quality tailored solutions to meet the needs of clients. Over the last twelve months, we have been privileged to be involved in a diverse range of projects using open source, open data solutions to make meaningful change. This has included ongoing work with New Zealand’s [Ministry of Business, Innovation and Employment](https://www.mbie.govt.nz/), and the development of open data portals for [Living Lakes Canada](https://livinglakescanada.ca/), a community-based organisation that undertakes a diverse range of water monitoring activities in the Columbia Water Basin, in the western Canadian province of British Columbia. and [Keck Medicine](https://www.keckmedicine.org/) at the [University of Southern California](https://www.usc.edu/). The latter also included the provision of a training and support program to ensure the smooth establishment and running of the portal. We have continued to do a considerable amount of work for the New South Wales Government. Among these were two projects for the [Department of Planning, Industry and Environment](https://www.dpie.nsw.gov.au/), one of which involved a complete redesign and upgrade of the Department’s [Sharing and Enabling Environmental Data](http://Sharing%20and%20Enabling%20Environmental%20Data) portal, which brings together state-wide data on land, water and air, and plant and animal life. [Link Digital](https://linkdigital.com.au/) finalised an extension of the [Sydney Botanic Garden’s site](https://www.botanicgardens.org.au/), [a searchable what’s on guide for activities in the gardens](https://www.botanicgardens.org.au/whats-on), which includes a [global map feature](https://www.botanicgardens.org.au/gardens). And we worked on a soon to go live website for the new Vehicle Emissions Star Rating, an NSW program that has been endorsed by the Commonwealth Government and all states and territories. [Link Digital](https://linkdigital.com.au/) also built internal data portals, for the sharing of data within organisations, for the global medical NGO [Médecins Sans Frontières/Doctors Without Borders](https://msf.org.au/), and the NSW [Data Analytics Centre](https://data.nsw.gov.au/nsw-data-analytics-centre). The Centre is a first-of-its-kind body in Australia with the mission of building a world-class whole-of-state government data analytics operation to improve police design and service provision, ensure correct stewardship of the state’s data assets, and support the increased adoption of data-informed practices. The portal will streamline the secure sharing of non-public data by public servants at the state and local levels. ## **A growing presence in Canada** [Link Digital](https://linkdigital.com.au/) established a subsidiary company in Canada in 2023 and followed this up by a busy schedule of in-country activity. In September, our Chairman [Steven De Costa](https://www.linkedin.com/in/stevendecosta/) and CEO [Marc Evans](https://www.linkedin.com/in/mrmarcevans/) visited Canada, where De Costa was the keynote speaker at an event in Toronto co-hosted with the [Canadian Open Data Society](https://www.opendatasociety.ca/). This brought together participants from government, business and not-for-profit sectors to learn what governments in Australia and Canada are doing in the open data and data-sharing space, what the benefits have been, and how quality open data can be used to build public trust in government. De Costa was back in Canada in November to give the keynote at the [Canadian Open Data Summit](https://www.opendatasummit.ca/) on ‘[The Architecture of Trust: Open and Honest Data’](https://www.youtube.com/watch?app=desktop&v=g8JIaVVTLn4). [Link Digital](https://linkdigital.com.au/) has been thrilled by the welcome extended to us from the Canadian open data community, and how our values, approach and expertise have resonated with those of our Canadian colleagues. Excitingly, we finished the year by formalising official partnership agreements with two key players in the Canadian open data space, the Montreal-based data governance and digital strategy agency, [Open North](https://opennorth.ca/), and [Living Lakes Canada](https://livinglakescanada.ca/). These partnerships not only foreshadow further geographical expansion in terms of project possibilities open to us but the value and skills that we will be able to bring to future clients. ## **The continuing growth of CKAN** The [Comprehensive Knowledge Archive Network (CKAN)](https://ckan.org/) is a powerful ‘out of the box’ piece of open source software that can become an open data platform. Link Digital has provided CKAN-based open data platform services for over ten years, is a proud CKAN co-steward, and engages closely with its large and expanding user base. Over the last twelve months, [Link Digital](https://linkdigital.com.au/) has worked with this community on the next version of the software, CKAN 3.0, which should be ready for release in the first half of 2024. The new version will include several modernisations to CKAN’s tech stack, with the aim of making it more interactive, and improving search functionality and user interface for data consumers. This year has also seen powerful validation of CKAN’s significant impact. As part of the development of CKAN 3.0, the [National Science Foundation](https://www.nsf.gov/) in the United States has undertaken the [Pathways to Enable Open-Source Ecosystems or POSE project](https://civicdataecosystem.org/). This focused on how the CKAN’s effectiveness as an open data platform could be strengthened, and the steps necessary to adequately support CKAN’s maintenance and ensure the needs of all users are integrated into technical modifications going forward. The POSE Project found strong evidence of CKAN’s wide adoption. [It identified nearly 400 regularly updated CKAN data portals of different sizes in 59 countries](https://civicdataecosystem.org/2023/06/19/analysis.html), spread across six major continents, with Brazil and the United States having the largest prevalence, followed by Argentina, Australia, Canada, Germany, the UK, Spain, Italy, and Japan. Importantly, from the point of view of building the open data community, POSE identified that CKAN is used not only by large and sophisticated digital teams behind platforms such as [The United States Open Data Portal](https://data.gov/) (over 250,000 data sets) and [Open Africa](https://africaopendata.org/) (the largest repository of data on the African continent) but also individuals with little resources and technical training. The real-world benefits of open source technology such as CKAN were also recognised by the decision of the [Digital Public Goods Alliance](https://digitalpublicgoods.net/) in mid-2023 to award it the status of being a Digital Public Good (DPG). This was a recognition of CKAN’s value as a driver of positive change in helping to attain many of the Sustainable Development Goals put forward by the [United Nations (UN)](https://www.un.org/en/), and its use by multilateral organisations like the [UN Refugee Agency](https://www.unhcr.org/), the [United Nations Office for the Coordination of Humanitarian Affairs](https://www.unocha.org/), as well as philanthropic organisations and by grassroots civil society movements. ## **The evolution of the open data movement** [Link Digital](https://linkdigital.com.au/) has been championing the benefits of making data open, including improved government decision-making and service provision and facilitating a more informed and involved citizenry, since 2012. But as the open data ecosystem continues to grow and evolve, we are keen to position ourselves to add value to the new ways that open data is being utilised: in corporate environmental, social, and corporate governance; in innovative ways of working for government and public servants; in building trust in public institutions and combating malicious large-scale disinformation campaigns; and in providing better quality data to help build models of artificial intelligence that are more trustworthy, safer, diverse and socially beneficial. Many of these future directions were crystalised for Link Digital during our participation in the [2023 Open Government Partnership (OGP) Summit](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/) in Tallinn, Estonia, in September. A movement of national and local governments and civil society groups to further the aim of open government, the focus of the 2023 OGP summit was on open government in the digital age and the potential for policy making to be more open and transparent and, thus, strengthen democracy. The role of open source software such as CKAN and the community around it was front and centre of a day-long side event at Tallinn, ‘[The Tech we want to open governments](https://okfn.org/en/events/the-tech-we-want-to-open-governments/),’ sponsored by [Link Digital](https://linkdigital.com.au/) and hosted by [Open Knowledge Estonia](https://okee.ee/) and [Open Knowledge Finland](https://www.okf.fi/). This discussed the future of government transparency and the role of civil society in helping to achieve it, and the digital technology solutions available to maximise the possibilities of the OGP and its support of open government. ## **Building the open data community** Link Digital’s role in the open data ecosystem is not just about data as a driver of economic value. We also want to continue to help build and strengthen the community of like-minded people interested in the importance of open data and stay up to date with the latest developments in the field. As part of this, this year [Link Digital](https://linkdigital.com.au/) kicked off a series of free monthly online forums. Speakers so far have included [Maggie Finkle-Aucoin](https://livinglakescanada.ca/profile/team/maggie-finkle-aucoin/) from [Living Lakes Canada](https://livinglakescanada.ca/) [on the award-winning Columbia Basin Water Hub project](https://www.youtube.com/watch?v=IVcSgeI_Z_E), [Jaimie Boyd](https://www.linkedin.com/in/jaimieboyd/), National Digital Government Leader at [Deloitte Canada](https://www2.deloitte.com/ca/en/pages/about-deloitte/articles/home.html), [on the government’s use of open data in Canada](https://www.youtube.com/watch?v=u5eQY8gRLa0), and [Pia Andrews](https://www.linkedin.com/in/pia-andrews/) [on Australia’s “Public Servant Revolution”](https://www.youtube.com/watch?v=TsSOhbgsHZs). [Link Digital](https://linkdigital.com.au/) has been an active participant in consultations around the formulation of Australia’s[ third National Action Plan](https://www.ag.gov.au/integrity/australias-open-government-partnership/australias-third-national-action-plan), as required as part of the country’s OGP membership. We have also been involved in the Australian government’s draft [*Data and Digital Government Strategy*](https://consultations.ag.gov.au/integrity/open-government-partnership/), which sets out the vision for using data and digital capabilities to deliver simpler, more secure public services and for building a more digitally enabled public service. ## **Policy-to-Practice Accelerator Program** While attending the [Canadian Open Data Summit](https://www.opendatasummit.ca/) in November, De Costa held an Executive Briefing on a new Policy-to-Practice Accelerator Program tailored for government teams, that will enter a discovery phase to be facilitated by [Link Digital](https://linkdigital.com.au/) and [Open North](https://opennorth.ca/) in early 2024. The Program is aimed at assisting government staff and agencies to explore more adaptive policy management alongside the principles of open knowledge. It will offer practical resources, training, and digital mentorship on the use of open data and the innovative work practices that can flow from it. We hope that the Program will help foster more responsive and effective government policies to address the needs of our rapidly evolving society. The Program is very much a response to the debates occurring in Australia and in global forums such as the OGP around the role that open data can play in enhancing government openness and public participation. At the Tallinn Summit mentioned earlier, the OGP launched an ambitious five-year strategy called the [Open Government Challenge](https://www.opengovpartnership.org/the-open-gov-challenge/), to increase commitments by government and civil society members to address themes like anti-corruption, digital governance, and the protection of civic space. We hope as the Policy-to-Practice Accelerator Program develops it will evolve into something that can be co-created by a diverse range of international stakeholders, thus ensuring its alignment with the principles of the OGP and the CKAN community. The Policy-to-Practice Accelerator Program is just one of many activities that [Link Digital](https://linkdigital.com.au/) is looking forward to in 2024. But that’s next year. Right now, we hope you enjoy your end of year celebrations and will take great comfort and joy from whatever traditions you observe. See you in 2024! **Categories:** All articles, CKAN, Government **Tags:** CKAN, Community, open data --- ### [New partners and program: Canadian Open Data Summit signals Link Digital’s growing global presence](https://linkdigital.com.au/news/2023/12/new-partners-and-program-canadian-open-data-summit-signals-link-digitals-growing-global-presence/) **Published:** December 5, 2023 **Author:** Andrew Nette **Content:** The fact that Link Digital is an established player in the Australian open data space doesn’t mean that we don’t have much to learn about the international market and the local contexts in which we work overseas. In this respect, our participation in the Canadian Open Data Summit in Victoria, British Columbia, in late November represents a milestone in the maturity of our international activities, with new partners and activities announced. [Link Digital](https://linkdigital.com.au/) has been active as a digital agency, focusing on open data-oriented services since the beginning of Australia’s open data movement a decade ago. We designed, hosted and supported one of the Australian national government’s earliest open data portals, [The Australian Government Open Data Portal](https://data.gov.au/home), established in 2013, and have gone on to work on government data portals in New South Wales ([Data NSW](https://data.nsw.gov.au/)), South Australia ([Data SA](https://data.sa.gov.au/)), Western Australia ([Data WA](https://data.wa.gov.au/)), and Victoria ([Data Vic](https://www.data.vic.gov.au/)), as well as for individual government agencies, non-profits and commercial organisations. “In establishing a subsidiary in Canada earlier this year, we moved out of our comfort zone,” said Link Digital Executive Director [Steven De Costa](https://www.linkedin.com/in/stevendecosta/?originalSubdomain=au). “It also became very clear from our initial investigation into the Canadian market that while we have very good technical skills and experience, we need to better engage with the skills and knowledge of local organisations.” In this respect, Link Digital is thrilled to have formalised official partnership agreements with two key players in the Canadian open data space, [Open North](https://opennorth.ca/) and [Living Lakes Canada](https://livinglakescanada.ca/). “Both Open North and Living Lakes Canada are mission-aligned partners that, like us, are passionate about using open data to solve real-world problems and advance the public good; blending our skills and experience will not only enlarge the three organisations’ geographical coverage in terms of project possibilities but also the value proposition we can bring to future clients.” – **Steven De Costa, Chairman and Executive Director, Link Digital** [Open North](https://opennorth.ca/) is a Montreal-based not-for-profit that works alongside governments, and civic-focused organizations and businesses on data governance and digital strategy. Living Lakes Canada is a community-based organisation undertaking a diverse range of water monitoring activities in the Columbia Water Basin in the western Canadian province of British Columbia. Link Digital has worked with [Living Lakes Canada](https://livinglakescanada.ca/) previously and recently helped upgrade its [Columbia Basin Water Hub](https://data.cbwaterhub.ca/). Maggie Finkle-Aucoin, [Living Lakes Canada’s](https://livinglakescanada.ca/) Team/GIS and Database Coordinator, spoke at [Link Digital’s November 2023 Public Forum on the organisation’s work and the Columbia Water Basin Hub](https://www.youtube.com/watch?v=IVcSgeI_Z_E), which won the 2023 [Canadian Open Data Summit](https://www.opendatasummit.ca/) Open Data Quality Award for its role as ‘a shining example of accessible fresh water data.’ The [Living Lakes Canada](https://livinglakescanada.ca/) partnership will be focused on open data projects in the Canadian water sector, including monitoring and stewardship of water resources. This will have many benefits, including generating data that can be used to examine the impacts of climate change at the local, national and international levels. The partnership with [Open North](https://opennorth.ca/) will work towards taking in projects not just in Canada but also in the United States and Europe. “We are excited to partner with Link Digital, as their expertise in technical development and data portal management complements our data governance and digital strategy advisory services; our combined vision and abilities will provide our clients with a stronger continuum of support.” – **Merlin Chatwin, Executive Director, Open North** ## **Policy-to-Practice Accelerator Program** De Costa delivered the keynote at the [Canadian Open Data Summit](https://www.opendatasummit.ca/) on ‘The Architecture of Trust: Open and Honest Data’. During his time in Canada, he also held an Executive Briefing on the new Policy-to-Practice Accelerator Program tailored for government teams, which will be delivered by Link Digital and Open North in 2024. The Policy-to-Practice Accelerator Program is aimed at assisting government staff and agencies to explore more adaptive policy management alongside the principles of open knowledge. It will offer practical resources, training, and digital mentorship on using open data and the innovative government practices that can flow from it. The hope is that Policy-to-Practice will help foster government policies to address the needs of our rapidly evolving society in a more effective and responsive manner, from climate change to helping to inoculate civic spaces and processes, like elections, from the impacts of deliberate large-scale malicious disinformation. Over time, the aim is for the Policy-to-Practice Program to develop into something co-created by a diverse range of international stakeholders. This will ensure its alignment with the principles of the [Open Government Partnership](https://www.opengovpartnership.org/) (OGP) and the [Open Knowledge Foundation](https://okfn.org/en/) (OKF), as well as crucial open-source software such as [Comprehensive Knowledge Archive Network](https://ckan.org/), of which Link Digital is co-steward. “By aligning with OGP and OKF principles, Policy-to-Practice is committed to enhancing government openness, fostering public participation, and promoting the sharing of open data and knowledge,” noted De Costa. “This alignment ensures that the program will not only be innovative but grounded in the values of open governance.” [Link Digital](https://linkdigital.com.au/) and [Open North](https://opennorth.ca/) invite interested individuals and organisations to join us on this exciting journey towards transformative policy management. Stay connected with Link Digital and Open North to receive updates on the Policy-to-Practice program’s progress. Be sure to [sign up for our kick-off in early 2024](https://pages.insightly.services/linkdigital_briefing_materials), where we will nurture the seeds of change. **Categories:** All articles, Technology Infrastructure **Tags:** Canada, open data, partnership --- ### [From Tallinn to Toronto: new opportunities and new threats to the open government and open data movement](https://linkdigital.com.au/news/2023/10/from-tallinn-to-toronto-new-opportunities-and-new-threats-to-the-open-government-and-open-data-movement/) **Published:** October 3, 2023 **Author:** Andrew Nette **Content:** Link Digital took part in two international events in September. Executive Director, Steven De Costa attended the [2023 Open Government Partnership (OGP) Summit](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/) in Tallinn, Estonia. This was followed by a visit by Steven and [Link Digital](https://linkdigital.com.au/) CEO Marc Evans to Canada to mark the company’s expansion into that market. Both activities were a powerful affirmation of company’s work in the open data and digital space since it was established in 2001. They also confirmed the value of open data as a force for good in helping to encourage a more informed citizenry, greater government transparency and accountability, and helping to deal with real world problems such as climate change, deliberate misinformation, or unethical models of artificial intelligence. [Link Digital](https://linkdigital.com.au/) emerged from both activities not only feeling strongly positioned in the global open data ecosystem, but with an even greater desire to be active in this space, in a business and advocacy sense. ## **Tallinn: threats and opportunities for open government and open data** The [OGP](https://www.opengovpartnership.org/) is a movement of national and local governments and civil society groups to further the aim of open government. The focus of the 2023 Summit, which took place on September 6-7th, was open government in the digital age and the potential for policy making to be more open and transparent and, thus, strengthen democracy. The Summit occurred against a radically different global backdrop to that which existed when the organisation was founded in 2011. There is now more evidence than ever of the positive impact open data can make in supporting greater democracy. But we also face a range of new threats: deliberate and systematic large-scale disinformation spread by malicious actors; a global lurch towards authoritarianism and attacks on human rights, and a declining security situation. As Estonia’s Prime Minister [Kaja Kallas](https://www.valitsus.ee/en/prime-minister-ministers/prime-minister-kaja-kallas) put it, this new reality was symbolised most obviously by the fact that the Summit took place a little more than 1,000 kilometres from the capital of Ukraine.1 [In a recent post on our site](https://linkdigital.com.au/news/2023/09/the-open-source-software-community-a-vital-ally-of-government-on-the-road-to-tallinn/), we posited the [Comprehensive Knowledge Archive Network (CKAN)](https://ckan.org/), a piece of open-source software that can be configured and set up to function as a data platform, and the open source data community around it as natural allies of the open government movement. Not only does [CKAN](https://ckan.org/) have the potential to provide real world benefits as a long term piece of digital public infrastructure but its user community can amplify [OGP’s](https://www.opengovpartnership.org/) aims and principles. The role of open source software and the community around it was front and centre of a day-long side event at Tallinn, sponsored by [Link Digital](https://linkdigital.com.au/) and organised by [Open Knowledge Estonia](https://okee.ee/) and [Open Knowledge Finland](https://www.okf.fi/). Entitled, ‘[The Tech we want to open governments](https://okfn.org/en/events/the-tech-we-want-to-open-governments/),’ according to De Costa, the event “brought together a diverse group of people around the idea that technologies like [CKAN](https://ckan.org/) have a positive role in enabling open government on a foundation of open data. Government can use [Digital Public Goods](https://digitalpublicgoods.net/) to establish [Digital Public Infrastructure](https://www.undp.org/digital/digital-public-infrastructure) (DPI) and collaborate in accord with the [Standard for Public Code](https://digitalpublicgoods.net/standard/). All three are in alignment with CKAN and the services we provide at [Link Digital](https://linkdigital.com.au/).” The [United Nations Development Program](https://www.undp.org/) defines a DPI as ‘a combination of (i) networked open technology standards built for public interest, (ii) enabling governance, and (iii) a community of innovative and competitive market players working to drive innovation, especially across public programmes.’ 2 A Standard for Public Code is ‘a set of specifications and guidelines designed to maximise consensus about whether a digital solution conforms to the definition of a digital public good.’ 3 The Tallinn Summit outlined an ambitious plan to expand the OGP, [particularly focused on increasing local government members](https://www.opengovpartnership.org/ogp-local/join-ogp-local-call-for-expressions-of-interest-2023/)hip. It also saw the launch of the [Open Government Challenge](https://www.opengovpartnership.org/the-open-gov-challenge/), a five-year strategy to increase commitments by government and civil society members to address themes like anti-corruption, digital governance, climate change, and open justice. 4 “It was clear that those participating in Tallinn recognised the potential for data and digital to unhinge or fracture societies, and participants discussed strategies that would safeguard it from threats and bolster any weaknesses,” said De Costa. “The ethical use of AI and the cleansing of information spaces by fighting disinformation and misinformation was seen as a particular priority.” While the [OGP](https://www.opengovpartnership.org/)’s members states are all broadly committed to open government, each faces different challenges to realising it: resource constraints, issues relating to political culture and national institutions, historical factors, and external threats. “[Open Government Partnership](https://www.opengovpartnership.org/) discussions can oscillate between one side where deeply impactful issues drive openness on a current of activism, to the other side where strong principles of openness drive reforms toward better practices,” noted De Costa. “However, between the extremes are mild and ongoing improvements, and a maturing of our collective understanding that open governance is simply a healthy way to operate collectively.” Link Digital was particularly glad to see the Australian government’s active re-engagement with the [OGP](https://www.opengovpartnership.org/) process. This is evidenced by the presence in Tallinn of a delegation from Australia’s [Open Government Forum](https://www.ag.gov.au/rights-and-protections/australias-open-government-partnership/open-government-forum), and the [recent consultations to help formulate Australia’s third *National Plan of Action*](https://consultations.ag.gov.au/integrity/open-government-partnership/). National government members of the [OGP](https://www.opengovpartnership.org/) are required to develop National Action Plans outlining concrete open government reforms, through a multi-stakeholder process that actively engages citizens and civil society. Australia’s second plan was delivered late and the deadline for the third missed altogether, jeopardising Australia’s continued membership. 5 Australia’s finalised plan is due by the end of the year. ## **Canada: being embraced by the open data community** [Link Digital](https://linkdigital.com.au/) recently incorporated a subsidiary entity in Canada, Datashades Inc trading as Link Digital Canada, and our visit was part of our ongoing orientation to the country’s open data ecosystem and how best to use our Australian experience to add value in the Canadian context. De Costa was key note speaker at an event in Toronto co-hosted with the [Canadian Open Data Society](https://www.opendatasociety.ca/), a non-profit that hosts the annual [Canadian Open Data Summit](https://www.opendatasummit.ca/) (which will take in Victoria, British Columbia, on November 23rd and 24th this year). The Toronto event brought together participants from the government, business and not-for-profit sectors to learn what governments in Australia and Canada are doing in the open data and data sharing space, what the benefits have been and how quality open data can be used to build public trust in government. Also featured was [Cara Scarfone](https://www.linkedin.com/in/carascarfone/) of [Treasury Board Canada](https://www.canada.ca/en/treasury-board-secretariat.html), speaking on Canada’s open data commitments in its [*2022-24 National Action Plan on Open Government*](https://open.canada.ca/en/content/national-action-plan-open-government), [Paul Connor](https://www.linkedin.com/in/paulconnorincanada/), Executive Director of the [Canadian Open Data Society](https://www.opendatasociety.ca/), and [Toronto City Councillor Paul Ainslie](https://www.toronto.ca/city-government/council/members-of-council/councillor-ward-24/). Conner briefed the event on the Society’s current project of mapping open data ecosystems across national, provincial, territorial and municipal governments in Canada, as well as in civil society and the private sector. The most pleasing aspect of the Canada visit, which also included an event with [Innovate Ontario](https://www.oc-innovation.ca/), was the enthusiasm with which [Link Digital](https://linkdigital.com.au/) was welcomed into the Canadian open data ecosystem. Our values and approach resonated with those of our Canadian colleagues, and our expertise is viewed as one hundred per cent relevant, especially in public sector circles. “Delivering the keynote at an evening of talks with the [Canadian Open Data Society](https://www.opendatasociety.ca/) was an entirely welcoming experience,” said De Costa. “Supporting those providing advocacy for open data is important for [Link Digital](https://linkdigital.com.au/), for [CKAN](https://ckan.org/) and for me.” ## **Where to from here?** The Tallinn Summit and the Canadian visit confirmed [Link Digital’s](https://linkdigital.com.au/) belief that open data, much like human rights, is a movement built on shared values. “Heading into Tallinn I was concerned that perhaps participants at [OGP](https://www.opengovpartnership.org/) would have moved past open data, but I need not have worried,” said De Costa. “Open data remains recognised as an essential component in supporting open, healthy and productive societies. In Toronto, I was then able to experience the energy of a healthy community of practice, brought together by the [Canadian Open Data Society](https://www.opendatasociety.ca/).” Like any movement, open data needs not just an infrastructure but consistent collective advocacy to further its aims. [Link Digital](https://linkdigital.com.au/) emerged from its recent activities with a renewed determination to continue to support both. In terms of our international work, [Link Digital](https://linkdigital.com.au/) has ideas for how to accelerate the uptake of open data solutions in Canada. We are a sponsor of the upcoming [Canadian Open Data Summit](https://www.opendatasummit.ca/), due to be held in Victoria, British Columbia in November, [where De Costa will be a keynote speaker on the subject of, ‘The architecture of trust: open and honest data’](https://www.opendatasummit.ca/wp-content/uploads/2023/09/cods23-programmation-en.pdf). While it can sometimes seem far from these global debates, Australia is, of course, part of the open data movement, and our polity faces many of the same problems and opportunities as other [OGP](https://www.opengovpartnership.org/) participants: global warming; the threat of deliberate disinformation – a factor vividly on display in our current constitutional referendum – and the challenge of getting our open data and digital settings right to improve government service provision and evidence-based policy formulation, ensure transparency, and build public trust. The remaining part of 2023 will see [Link Digital](https://linkdigital.com.au/) focused on two important processes underway locally. First, is the government’s upcoming *2022-2024 National Plan of Action*. Developed as part of our [OGP](https://www.opengovpartnership.org/) obligations. We hope it will embody a more ambitious agenda for open government reform than has been the case in previous plans. Second, is the next version of the government’s draft [*Data and Digital Government Strategy*,](https://www.dta.gov.au/digital-government-strategy) due to be released at the end of the year. In [Link Digital’s](https://linkdigital.com.au/) submission to the consultation process we said that the draft *Strategy* succeeds in setting out many of the key aims, skills and aptitudes necessary for the government to take its data and digital capability to the next level. But we suggested the *Strategy* would be improved by embedding it in a much more robust values framework. If there is one thing that has been made clear to us over the last month, it is the need to frame data and digital initiatives much more firmly as part of a mission to improve trust in government, engage with a wider array of stakeholders in the digital ecosystem, and inoculate public institutions from the threat of disinformation. As an organisation deeply committed to effectively leveraging open data to solve real-world problems, [Link Digital](https://linkdigital.com.au/) understands the necessity of creating ethical AI. One important way we can begin to have a meaningful impact in this area is through engaging in discussions about the importance of open data and how we can make it work for greater transparency, equity, and democratic accountability. This is one of the many topics that will be discussed in a new series of forums being held by Link Digital on the last Thursday of every month, Australian EST. These forums will connect you with like-minded experts who are passionate about the importance of open data and want to stay updated on the latest developments in the field. They are free to attend and open to everyone[.](https://linkdigital.com.au/link-digital-public-forum/)[ Register today](https://linkdigital.com.au/link-digital-public-forum/). --- 1 “Prime Minister of Estonia Welcomes Open Government Leaders to Tallinn,” *Open Government Partnership*, September 6, 2023, 2 “Digital Public Infrastructure,” United Nations Development Program, accessed September 26, 2023, 3 “Digital Public Good Standard,” Digital Public Goods Alliance, accessed September 26, 2023, [https://digitalpublicgoods.net/standard/#](https://digitalpublicgoods.net/standard/) 4 “Prime Minister of Estonia Welcomes Open Government Leaders to Tallinn,” Open Government Partnership, September 6, 2023, [https://www.opengovpartnership.org/news/key-announcements-at-the-2023-ogp-global-summit/](https://www.google.com/url?q=https://www.opengovpartnership.org/news/key-announcements-at-the-2023-ogp-global-summit/&sa=D&source=docs&ust=1696299265804136&usg=AOvVaw3_eLgB-IRvT38wQQcukrPH) 5 “Open Government Partnership – Warning to Australia!” Open Government Partnership, February 22, 2022, **Categories:** All articles, Amazon Web Services (AWS), CKAN, Drupal, Environmental/Climate Change, Open Data **Tags:** digital government, open data, open data movement, open government, open knowledge --- ### [Interview: Mapping digital public infrastructure globally](https://linkdigital.com.au/news/2025/12/interview-mapping-digital-public-infrastructure-globally/) **Published:** December 9, 2025 **Author:** Andrew Nette **Excerpt:** Measuring the impact of digital public infrastructure, its origins, and a different way of doing digital services. Read more... **Content:** Digital public infrastructure (DPI) is a term I’ve been hearing with increasing frequency over the last year. DPI are core digital systems that enable governments to function better and ensure that people, organisations and governments can interact, exchange information and access services securely and easily. But how prevalent is DPI and how does it differ from previous ways of governments doing digital infrastructure? And, connected to its function in delivering better public services, can it play any role in reversing the erosion of trust between citizens and their governments? One person who is involved in these debates is [Krisstina Rao](https://www.linkedin.com/in/krisstina-rao/ "Krisstina Rao"). The Berlin-based Rao is a Research Fellow at University College London and manages the [DPI Mapping Project](https://dpimap.org/) undertaken by the university’s [Institute for Innovation and Public Purpose](https://www.ucl.ac.uk/bartlett/public-purpose). The map aims to advance understanding of the state of DPI around the world by developing a baseline dataset on DPI initiatives and highlighting best practices around their development. I sat down with her to discuss the emerging area of DPI and the issues around it. ![Interview: Mapping Digital Public Infrastructure Globally](https://linkdigital.com.au/wp-content/uploads/2025/12/Mapping-DPI-globally-1024x535.webp)## A different way of doing digital services Undertaking a high level scan of 210 countries, the DPI Mapping Project identifies three key areas in which DPI is being implemented: digital identity systems which enable residents to verify their identity once and, thereby, access a range of government services; digital payment systems that have a public interest operator and can facilitate real-time financial transactions; and digital data exchange systems that share data across sectoral/national levels, including sharing data crucial to public service delivery. While these systems have been in existence for some time, Rao contends that the DPI concept that now increasingly underpins their development is relatively new. > For a very long time, especially in digital development, tech was being sold to governments as a way to solve problems at scale. But they were not taking into account what it means for tech to be absorbed into government IT departments or service units. What typically ended up happening is governments ended up paying for software and hoping that they could keep it up to date, scale it up and scale it down and modify and customise it, depending on their needs as they emerged. The problem was the capacity to manage it wasn’t ever in these government departments, it was always outsourced to a vendor. And what ended up happening is that a lot of these vendors became, as is the nature of markets, rather locked into this ecosystem, \[and\] it was very difficult for governments to pull out. If stuff was not working for them, they couldn’t leave these \[software\] agreements. These agreements were also often very expensive. DPI involves a rethinking of how governments, particularly in global majority countries, invest in digital services and which aspects they outsource versus which they build capacity to manage internally. > It doesn’t involve governments investing in software repeatedly for every new use case. We are trying to say, think about what is common among all these procurements and invest in that as infrastructure, and try to own and operate it yourself. So, you have less dependency on these vendors, which creates a certain amount of sovereignty and autonomy that comes with you owning and operating this infrastructure. Another difference involves investing in digital infrastructure to not only solve problems at scale but using a tech stack that can be repurposed across multiple government departments and functions. > Previous ways to create digital transformation have typically been siloed vertical stacks that the health department is building, the transport department is building, that the social welfare department is building, etc. And what’s happened is that while it’s transformed workflows and value chains in public administration and service delivery, it’s not actually transformed the way that governments actually invest in digital and helped them create accessible service for citizens. As well as using the same technological building blocks, DPI also involves developing common delivery standards, common data pools or lakes, and governance guidelines to guide the work across different departments and services and ensure uniform quality. ## Origins of the mapping project The project to map the international prevalence of DPI started about two years ago. The inspiration was that a handful of countries – India, Brazil, Estonia, etc – were starting to adopt this approach and there was discussion that it had benefits, and more countries should be adopting it. > But this felt very loose as an argument and it didn’t seem grounded at all, and we realised that we just needed to prove this empirically and maybe even prove the statement wrong. Because what we truly believed was that DPI was way more prevalent than people were saying. Initially the project didn’t involve mapping, “it was just a framework for thinking through this is what we can measure and this how we can measure it. What does DPI look like from a public administration point of view but also from a technological point of view, what is the governance approach, etc.” Over time, as more data was gathered, the mapping concept evolved. The map contains all the publicly available data on the prevalence of the three key DPI types that Rao and her team can find. “If there is more data out there it needs to come from new sources.” The team are currently contemplating using AI tools to help with web scraping to try and source additional data. They also want to create more sustainable data sourcing pipelines with DPI practitioners who may be closer to things happening on the ground. While Rao believes “the map is impactful and useful if the people who come to it find the data useful,” she is also thinking about different sets of users and what they might take away from it. > Researchers and funders will take away one thing. Others, for example DPI practitioners in the Latin American and Caribbean region are very interested in cross border transactions. How does DPI enable cross border data transactions for them? This is also a very big thing in Africa. So, we are interested to see what a regional deep data dive would look like. ## Measuring the impact of digital public infrastructure The question of how to isolate and evaluate the impact of specific DPI initiates – something that is deliberately not measured in the map – is a complicated issue. > Evidence is very sparse right now. Which is why us talking about prevalence and just setting out what DPI is across the world, rather than diving into impact, mattered to us. And now we feel like there is more credible evidence on the impact coming up. To me, if it is working it means it is being used as a tool or an infrastructure. And then I would look at adoption metrics, like how many IDs are being issued or how many transactions are taking place. Who is using DPI for what kind of service delivery? How seamless is that service delivery, how inclusive. Things like that. Some view DPI as having the potential to play a role in reversing the erosion of trust that is occurring in many countries between citizens and their governments. [As I wrote in a recent article](https://linkdigital.com.au/news/2025/10/what-is-digital-public-infrastructure-and-can-it-help-reverse-the-decline-in-public-trust-in-government/), it was one of the topics that dominated discussions at the recent Open Government Partnership Summit 2025, in Vitoria-Gasteiz, Spain. > I am a researcher, so I am never thinking in absolutes,” says Rao. “I don’t know that there is enough evidence to say that adopting DPI is co-related with a government that is enjoying high trust. But there are, Rao maintains, indications of DPI’s benefits in other areas, which could arguably have a part in generating greater public trust in government. She cites the example of [India’s digital ID system, known as Aadhaar](https://uidai.gov.in/en/). It uses a 12-digit unique identity number that can be obtained voluntarily by all residents of India, based on their biometric and demographic data. A mixture of open source and proprietary tech, approximately 90 per cent of the country’s 1.4 billion citizens now use Aadhaar in their interactions with everything from social welfare services and university entrance to employment and taxation. > It plugged, I don’t know the exact number, between 30-40% of financial leakages… So, any issues with corruption, any issues with middlemen absorbing money that is otherwise supposed to flow to the poor, all of those got quelled. Apart from obvious short term impacts, such as saving costs and more efficient administration, Rao believes there is also merit in thinking about DPI’s longer term impacts. “Things like, how are competition and markets affected? How is it changing entry or exit barriers in a certain market? Is it enabling value creation at news layers of the technology stack? These are metrics that are very poorly understood.” ## The role of open source technology Another aspect of DPI not measured by the mapping project – and of particular interest to Link Digital – is the prevalence of open source software. > We did not want to look for open source, because if we did, we would kind of be imposing an unintentional performance benchmark on countries. For us to be able to track from a desk based methodology point of view, whether a government is using open source or not, is also a bit of a misnomer, involving all kinds of complex questions. A government might start by using open source tech, but might fork it and then have a proprietary vendor come and work on other aspects of it, etc. There are also important questions in terms of the support that governments can get for using open source applications, what is the vendor support ecosystem and how can DPI based on open source technology be made sustainable over the long term. > That said, these kinds of questions are emerging, and they are only emerging because open source is becoming a bigger and bigger part of the conversation as countries think through how to build their DPI. If it wasn’t so, then it \[open source\] would be an afterthought. ## The importance of safeguards One issue Rao is very keen to emphasise concerns the provision of adequate safeguards for DPI. This is particularly important given that the narrative around DPI is sometimes very technology led. > We need to look at how this tech is not existing in an isolated bubble. It is being absorbed in an institutional set up that is going to be subject to the same kind of vulnerabilities as any other institution. So, you need to think about how this technology is going to be absorbed and how it creates value for a bunch of different people and not just some. But also, it doesn’t take away value from any of them. Safeguards became an important way to think about this. [One framework that governments can operationalise to ensure their DPI development includes adequate safeguards is the Universal DPI Safeguards Framework](https://www.dpi-safeguards.org/), which is based on United Nations principles. In its second year of development, the framework looks at principles such as do not harm and do not exclude, etc, as well what does a particular DPI initiative mean for market dynamics and competition. > Safeguards has become very much a way for governments to think about implementation, but from a people first lense. So, you think about these principles being implemented alongside the technology being absorbed, regardless of whether it is open source or proprietary. To what extent are you creating a stack that is almost entirely dependent on proprietary tech? Are you creating the same vendor lock-ins that you were trying to run away from? I would say, before safeguards existed there were just a lot of sticky questions around thinking through the governance of DPI and safeguards has now created a vocabulary and a sort of tool kit for not only governments but other stakeholders to think about their implementation issues. **Categories:** All articles, CKAN, Digital Public Infrastructure, Drupal, Government, Industry, Topics **Tags:** Digital public infrastructure, Open source technology --- ### [DCAT 101: unlocking the power of data through standardisation](https://linkdigital.com.au/news/2025/01/dcat-101-unlocking-the-power-of-data-through-standardisation/) **Published:** December 12, 2025 **Author:** Kate Sampher **Content:** Finding what you need in the landscape of data can sometimes feel like a daunting task. But what if there was a way to make all that data more easily discoverable and usable? That’s where [Data Catalogue Vocabulary (DCAT)](https://linkdigital.com.au/news/2024/09/what-is-dcat-and-why-is-it-important-for-data-catalogs-and-open-data-portals/) is essential. This standard, recommended by the [World Wide Web Consortium (W3C)](https://www.w3.org/TR/vocab-dcat-3/), aims to bring order to the chaos by providing a common language for describing datasets. The following article will be useful for data professionals in organisations that want to improve their data management and sharing capabilities, rather than having to build custom solutions from scratch by using DCAT and DCAT Application Profiles. - [What is DCAT?](#aioseo-what-is-dcat) - [Risks of not adopting the DCAT](#aioseo-risks-of-not-adopting-the-dcat) - [Key steps for organisations to adopt DCAT](#aioseo-key-steps-for-organisations-to-adopt-dcat) - [Key points to remember](#aioseo-key-points-to-remember) ## **What is DCAT?** So what exactly is DCAT? Simply put, it’s a set of terms that data publishers can use to provide information about their datasets, like the title, description, keywords, publisher, and so on. By using these standard terms, different data catalogues can ‘speak the same language’ and share information more easily. “Interoperability is like a big word that essentially means that different systems play well together,” says Adria, Senior Solutions Architect and a DCAT expert. Getting started with DCAT is easier than you might think. Organisations can begin with basic features and add more complex ones as they grow. It’s like learning a new language; you start with simple phrases and gradually build up to more complex conversations. What makes DCAT particularly powerful is its flexibility. While it works globally, different regions and industries can create their own special versions called ‘application profiles.’ For example, European organisations use [DCAT-AP](https://semiceu.github.io/DCAT-AP/releases/3.0.0/), a version specially designed for their needs. This flexibility ensures that DCAT can serve both general and specific requirements. > *DCAT specification allows for the creation of application profiles, which are essentially more targeted specifications for specific domains.* Modern technology increasingly relies on good data sharing. Artificial intelligence and machine learning systems especially benefit from DCAT because it helps them find and use data more efficiently. Organisations that don’t use DCAT risk falling behind, as their data becomes harder for others to find and use. Popular data management platforms like CKAN now include DCAT support built in. This makes it even easier for organisations to start using this important standard. As more organisations adopt DCAT, sharing data becomes smoother and more efficient for everyone. ## **Risks of not adopting the DCAT** - Decreased discoverability and interoperability of your organisation’s data. Without a common standard for describing metadata, other systems and applications will have difficulty discovering and integrating with your data. - Lost opportunities and value. By not adhering to a widely adopted standard like DCAT, you may miss out on opportunities to collaborate and share data with other organisations, limiting the potential value and impact of your data. - Potential compliance issues. In some regions or domains, adopting standards like DCAT-AP may be mandated or required, so not doing so could lead to regulatory or legal challenges. - Increased complexity and costs. Building custom, non-standard metadata management solutions can be more time-consuming and expensive than leveraging an established, community-driven standard like DCAT. DCAT isn’t just helpful—it’s becoming essential. By making data easier to find, share, and use, DCAT helps organisations work together better and make the most of their information resources. ## **Key steps for organisations to adopt DCAT** DCAT provides a good starting framework to initiate discussions within the organisation about how to describe their internal metadata. It provides them with a pre-defined set of vocabularies and properties from which they can select. Organisations don’t need to adopt the entire DCAT specification right away. They can start by identifying the core DCAT properties that are most relevant, like description, keywords, publisher information, provenance, etc., and gradually build out their metadata schema from there. DCAT allows for the creation of application profiles, which are more targeted specifications for particular domains or regions. So organisations can look at profiles like the Data AP Profile for EU data portals and use that as a guide for their initial DCAT adoption. The key is that DCAT provides a common framework that many systems already use, so it gives organisations a head start instead of having to build everything from scratch. It allows them to leverage existing vocabularies and best practices. ## **Key points to remember** - DCAT provides a common set of properties and vocabularies to describe data on the internet, enabling interoperability between different data catalogues and publishing systems. - DCAT can support AI and machine learning initiatives by providing well-structured metadata for data ingestion and training of models. - DCAT has application profiles (APs) that provide more specific guidance for regional or domain-specific use cases, such as the EU’s DCAT-AP and the US government’s DCAT-AP-US. - The risks of not adopting DCAT include reduced data discoverability and interoperability, potentially leading to missed opportunities and loss of value. - CKAN, an open-source data portal platform, provides out-of-the-box DCAT compliance through the [ckanext-dcat extension](https://github.com/ckan/ckanext-dcat), which simplifies the implementation of DCAT-compliant metadata. Interested in watching a video conversation on adopting open data standards? [Check out the interview ](https://www.youtube.com/watch?v=Zo75ZMlhyj0&t=3s)I had with one of the main CKAN experts, [Adria Mercader](https://amercader.net/), in the third episode of [Tuesday Talks](https://youtube.com/playlist?list=PLNYR4MdBNnu_50tgZti4Nmlon5AF7k6aL&si=jWhSj6zrjWwO-mZ1). **Categories:** All articles, Artificial Intelligence, CKAN, DCAT (Data Catalog Vocabulary), Government, Higher Education/Research, Open Data **Tags:** CKAN, DCAT --- ### [Canadian Open Data Summit 2025: Opportunities and threats for open data movement](https://linkdigital.com.au/news/2025/12/canadian-open-data-summit-2025-opportunities-and-threats-for-open-data-movement/) **Published:** December 11, 2025 **Author:** Andrew Nette **Excerpt:** Link Digital assesses the state of Canada's open data movement during the Canadian Open Data Summit 2025. Read the article now. **Content:** For the last three years running, Link Digital has been both a sponsor and an active participant in the [Canadian Open Data Summit](https://opendatasummit.ca/). It’s a great open data event, built on a great open data community. In addition to inspiring Link Digital to continue our work using open source technologies to build and secure data hubs and portals, this year’s CODS in late November provided a lot to think about, on everything from the state of open data to AI. Organised by the [Canadian Open Data Society](https://www.linkedin.com/company/canadian-open-data-society/?originalSubdomain=ca), this year’s CODS was combined with GovMaker Canada, an initiative led by the [Pond-Deshpande Centre at the University of New Brunswick](https://ponddeshpande.ca/govmaker/), focused on advancing public sector innovation and open government. For our [Technical Delivery Manager Lex Du Plessis](https://www.linkedin.com/in/lex-du-plessis/), the University of New Brunswick presentations were a Summit highlight. > They really gave the conference a bit of a different vibe and allowed me to listen in on conversations that gave a different perspective on how data is used and some of the struggles that are being experienced by the people that work with data. They really brought an academia perspective to some of the conversations around how data is generated and what you could do with it. I read STEM field papers and listen to podcasts covering these fields and having these guys present in the way that they did overlaps with my interests. ![With Link Digital and Panelists at the Canadian Open Data Summit 2025: Opportunities and threats for open data movement](https://linkdigital.com.au/wp-content/uploads/2025/12/img-steven-panel-CODS2025-1024x1024.png)Left to right: Lex Du Plessis, Philippe Fortin, Wildreda Edward and Steven De Costa ## **Artificial intelligence dominates discussion** As has been the case for most open data events Link Digital has taken part in this year, AI was the dominating topic. > A lot of the conversation at the conference was around how to use AI, using AI to help with data discovery, using AI for data insights and making data more accessible with AI by using natural language,” says Lex. “My feeling is everybody is working on this and looking to incorporate some form of AI into their ecosystems. > A second thing about AI was that there really is an uneasiness in these discussions. People are really scared of losing their jobs and I can completely understand their sentiment. Narrow AI is really seen as a tool and can support users as per point A, but General AI is seen as a bit of an intrusion and the fact that it’s being included into everything (Google, Microsoft, etc.) really makes people unconvertable. Moderated by Link Digital [Executive Director Steven De Costa](https://www.linkedin.com/in/stevendecosta/), on ‘[The Spooky Physics of Shared Understanding](https://opendatasummit.ca/speakers/).’ It featured Lex, [Wilfreda Edward](https://www.linkedin.com/in/wilfreda-edward-4069066a/) of the [Canadian Centre For Nonprofit Digital Resilience](https://ccndr.ca/) , and [Philippe Fortin](https://www.linkedin.com/in/phfortin/), a Data Governance Specialist at the [Autorité régionale de transport métropolitain](https://www.artm.quebec/), discussing the paradox of how observing something changes the thing observed, and how this relates to open data practice and the shaping of our social and civic understanding of truth. [Senior Solution Architect Ian Ward](https://www.linkedin.com/in/ianward/) also touched on AI in his presentation on tools and best practices for publishing and working with data dictionaries, including some benefits of publishing machine-readable formats. > I’m very happy with how the session went and was pulled aside at the conference afterwards a number of times to discuss data dictionaries. The technologies presented were new to many people attending, and collecting and sharing provenance, validation and other metadata along with published datasets was new to some. > Publishing important metadata as data dictionaries along with the data clarifies limitations, linkages and restrictions on that data. These insights let users make informed decisions about how the data is used and what conclusions that can be drawn from analyzing it. Machine readable data dictionary formats allow systems to align controlled vocabularies, implement compatible validation and republish key metadata about data they consume. Like CKAN, data dictionaries give users the context they need to understand, effectively integrate and confidently build solutions with data. > > ![Ian Ward at the Canadian Open Data Summit 2025: Opportunities and threats for open data movement](https://linkdigital.com.au/wp-content/uploads/2025/12/img-Ian-CODS-2025-1024x1024.png)Ian Ward ## **Threats and opportunities** The Summit underlined both opportunities and threats facing the open data movement going forward. “Open data has reached a level of maturity where we’ve moved past convincing people, and we’re now focused on remaining issues and getting the real work done,” says Ian. > There’s always a danger of backsliding though, especially when the path of least resistance is working in secret and not releasing data when it might lead to criticism or embarrassment. Many institutions have established patterns of working in the open. We should continue to draw attention to successes that are only possible by working this way so that these patterns become examples for everyone to follow. > High quality data with rich metadata is just as useful for AI tools as it is for humans. Data validation and controlled vocabularies can keep generative AI results from colouring outside the lines and metadata allows building queries or generating summaries with AI tools without breaking the bank by training models on every row. As AI features are integrated into any and every process the demand for clean, well described data to power these tools is only going to grow. > To me, it seems like open data has made some progress and has also slipped at the same time, contends Lex. > My takeaway from the conference is that people get the importance of open data. They are relying on it more and more, but this also seems like a two edged sword. I think the problem that might be starting to pop up is too much irrelevant data or data not really capturing the information that is really needed. > The example that comes to mind [is the most amazing dataset created by the province of Nova Scotia](https://www.engagenovascotia.ca/our-survey). The Engage Nova Scotia asked residents over 200 questions about how they feel about their province and the data that came out of that is just mind blowing. They are gearing up next year to repeat the survey and my question really is, why are we not doing this on a federal level. The amount of informed policy and decision making that can be based on this data would be amazing. ## **Link Digital: committed to the Canadian market** Link Digital’s participation in this year’s CODS comes on the back of the gradual success of our Canadian subsidiary, Datashades Ltd. According to Steven: > We have invested in Canada in the same way we have grown into our natural investment within Australia’s open data ecosystem. We secured clients in Canada in 2020, and we wanted to make sure we were there with all the authenticity and local ambition that has marked our history here in Australia. Lex agrees: > Link Digital really has the opportunity to position itself as a trusted partner when it comes to open data in Canada and globally as we navigate through this new world that is evolving around us. Talk to us about your data management capabilities.[Contact Link Digital ](https://linkdigital.com.au/get-in-touch/)to discover how our expertise can benefit your organisation. **Categories:** All articles, Artificial Intelligence, Government, Higher Education/Research, Non-profit/NGO, Open Data **Tags:** Canadian open data movement, open data --- ### [How artificial intelligence could change digital public infrastructure](https://linkdigital.com.au/news/2025/11/how-artificial-intelligence-could-change-digital-public-infrastructure/) **Published:** November 14, 2025 **Author:** Andrew Nette **Excerpt:** How artificial intelligence could change digital public infrastructure. **Content:** *This is the third and final in a series of articles on the* [*Open Government Partnership Summit 2025*](https://www.opengovpartnership.org/events/2025-ogp-global-summit/)*, in Vitoria-Gasteiz, Spain, in October. Technical Writer/Analyst* [*Andrew Nette*](https://www.linkedin.com/in/andrew-nette-9780a4266/?miniProfileUrn=urn%253Ali%253Afs_miniProfile%253AACoAAEEnKmwBauWuHRdrdS8uNElh2NnYzIh3tVU&skipRedirect=true&miniProfileUrn=urn%3Ali%3Afs_miniProfile%3AACoAAEEnKmwBauWuHRdrdS8uNElh2NnYzIh3tVU) *was one of the Link Digital members present at the event.* ![How artificial intelligence could change digital public infrastructure](https://linkdigital.com.au/wp-content/uploads/2025/11/3-AI-adoption-by-government-1024x535.webp)*Image by Anastasiia Shevtsova* For nearly two decades Link Digital has been working in the open data and digital space. In addition to becoming a trusted participant in the open source community, Link Digital is firmly established in the evolving data ecosystem, with a focus on supporting open data, digital service design and citizen centred design practices. And while it continues to be the bread and butter of the company’s business, the direction that open data is taking is changing. This was again reinforced for me at the recent [Open Government Partnership (OGP) Summit 2025](https://www.opengovpartnership.org/events/2025-ogp-global-summit/). That open data was mainly raised in the context of its centrality in developing transparent and public focused uses of AI, was no surprise. This is not just about how open data can be made more AI ready, but the ways in which AI is transforming how open data is created. But the Summit also tackled another emerging issue: how large language AI models will be incorporated into and help to transform digital public infrastructure (DPI) and linked to this, AI’s potential to enable greater public access to the data that is stored on platforms such as open data portals. ## Open data – still vital Underlining some of the discussion at the Summit is the reality that the impetus behind open data has faltered, part of a larger rethinking of the concept of openness triggered by several factors: the erosion of the social contract between people and governments; the activities of malicious anti-democratic forces; and the relentless scraping and appropriation – without compensation or consent – by AI companies, which has resulted in open data producers starting to shut their doors or adopt paywalls and access restrictions. But open data is still seen as vitally important, at least by attendees at the Summit. [The Open Government Partnership’s 2024-25](https://www.opengovpartnership.org/2024-2025-annual-report/) report shows that 40% of commitments from its member countries and local governments focus on public participation, digital transformation, and open data. ![How artificial intelligence could change digital public infrastructure](https://linkdigital.com.au/wp-content/uploads/2025/11/Andrew-at-OGP2025-scaled-1024x768.jpg)Link Digital’s Technical Writer/Analyst Andrew Nette in one of the workshops at the Open Government Partnership Summit 2025 in Spain. Image by Adria Mercader That said, there was discussion that open data advocates have taken acceptance of open data for granted and that there is a pressing need for a more aggressive effort to publicise the ongoing value of making data open and shareable. Key to this, open data needs to exist not just as a static property on public portals but be seen as helping meet challenges, such as climate change, innovation and closing the gap between democracy and service provision or, as some at the Summit referred to it, improving the democratic feedback loop. There was agreement around the many benefits of using quality open data to train large language models of AI. But there was also consensus, not just around open data as a core component of government digital public infrastructure (DPI), but how AI can be used to reshape the creation, management, sharing and access to open data in DPI such as open data portals. ## How artificial intelligence (AI) could change digital public infrastructure [I have written before on this site about the ways AI can benefit from open data and vice versa](https://linkdigital.com.au/news/2023/09/good-data-for-artificial-intelligence-what-does-it-mean-and-how-can-we-get-it/). Large language machine models need to be trained on significant volumes of data. Data that is higher quality – including being checked and standardised – will produce better, and more equitable and ethical AI outcomes. Open data can also benefit enormously from AI in terms of cleaning and error detection, bias identification, metadata enrichment, language translation, enriched metadata, and duplicate detection. Open data’s centrality to AI is a powerful argument not only for governments to focus on creating better open data infrastructure and policies to prioritise data quality, discoverability and useability, but to make more government data, particularly high value datasets, more open But AI is also reshaping the design of government DPI such as open data portals and catalogues. AI can help clean, link and enrich datasets and detect gaps and errors in public data sets automatically, enhancing data comprehension and use. But AI can also make open data more interoperable and interlinked, changing datasets so that they are not just static information on isolated portals to more accessible and interactive data on connected ecosystems. Several government representatives at the OGP Summit discussed how they are in the process of introducing AI powered chatbots or digital assistants into open data platforms and other DPI. Sometimes referred to as ‘conversational interfaces’, the aim is that these will change how citizens engage with data. Natural language search will help users easily visualise datasets. It can translate datasets and metadata into multiple languages and, in much the same way as a film or music streaming service, suggest related high value datasets. All of this could enable a better quality engagement by citizens as well as broaden the reach of data beyond data specialists. ## Major challenges While AI certainly brings benefits to DPI, it also throws up future challenges for DPI implementation. To cite just one, instead of designing one digital interface for everyone, AI will increasingly increase citizen’s expectations that they will be able to access variations tailored to their specific circumstances. [As I noted in my previous report on the OGP Summit](https://linkdigital.com.au/news/2025/11/transparency-in-the-race-by-governments-to-adopt-artificial-intelligence/), in terms of ensuring full transparency in relation to the AI technology applied to public services and digital infrastructure, governments need to adopt full algorithmic transparency. This includes publicly detailing why the AI algorithm in question was implemented in the first place, and clearly defining roles and responsibilities. This includes the importance of human supervision, such as regular audits and the traceability of decisions related to the technology. And, as Renato Berrino Malaccorto, Research Director at [Open Data Charter](https://opendatacharter.org/) stressed, the capacity to undertake such regulation varies greatly between countries and especially between developed countries and those in the global south. And, even in richer countries, regulatory frameworks for AI use in governments vary among countries, from actual legislation to just recommendations, and while few explicitly mention open data, many focus on data governance. There are also vital questions relating to the tech stack used in these initiatives. DPI should be designed for transparency, resilience and long term sustainability. Going forward, this shows the importance of sustainable, transparent, community driven, open source technologies, like [CKAN – the Comprehensive Knowledge Archive Network](https://ckan.org/). Going forward, it also underlines a continuing and vital role for the open data community and organisations like Link Digital that are part of it. **Categories:** All articles, Artificial Intelligence, Digital Public Infrastructure, Government, Open Data, Topics **Tags:** Artificial intelligence, Digital public infrastructure, OGP Summit 2025, open data --- ### [Link Digital CKAN experts: Global impact in 2025](https://linkdigital.com.au/news/2025/11/link-digital-ckan-experts-global-impact-in-2025/) **Published:** November 14, 2025 **Author:** Kate Sampher **Excerpt:** Here are some Link Digital’s remarkable contributions over the past year, which are reshaping how organizations worldwide manage, share, and leverage their data assets. **Content:** As we approach the end of 2025, the open data ecosystem continues to rapidly evolve. And Link Digital and its global team of CKAN experts are central to this. ![Link Digital CKAN experts: Global impact in 2025](https://linkdigital.com.au/wp-content/uploads/2025/11/1-CKAN-experts-1024x535.webp) Link Digital’s deep knowledge of and involvement in the governance, community engagement and technical development aspects of CKAN – including being a co-steward of the software and a key player in core tech team meetings – positions us as trusted advisors on open data to governments, NGOs, research institutions, and academic organizations globally. Let’s look at some of the remarkable contributions that Link Digital has made over the last year, that are reshaping how organizations worldwide manage, share, and leverage their data assets. ## **Enhanced user experience and file management** Leading the technical upgrades emerging from Link Digital’s expert team this year have been Senior Solutions Architects [Ian Ward](https://www.linkedin.com/in/ianward/?originalSubdomain=ca&skipRedirect=true&originalSubdomain=ca) and [Adrià Mercader](https://amercader.net/), whose contributions are setting new standards for data portal functionality. Ward’s Table Designer feature enables partial dataset updates rather than complete file reloads, dramatically reducing page latency for large datasets. The integration of HTMX for dynamic content refreshing provides smoother, faster interactions essential for large-scale portals. Working collaboratively with two of our developers, [Sergey Motornyuk](http://linkedin.com/in/sergey-motornyuk-a33226108/?originalSubdomain=ua) and [Oleksandr Cherniavskyi](https://theorg.com/org/qarea/org-chart/oleksandr-cherniavskyi), Ward has also improved CKAN’s file management capabilities. Their joint efforts have produced advanced file handling systems that treat files as first-class entities with detailed metadata and version history, enabling better tracking, audit trails, and sharing flexibility. The system now supports resumable uploads, multi-cloud storage, and eager data validation, addressing real-world challenges like unstable connections and heterogeneous infrastructure. ![Link Digital CKAN experts: Global impact in 2025](https://linkdigital.com.au/wp-content/uploads/2025/11/aioseo-ai-advanced-file-management-medium-illustration-landscape-20251112-022944-1024x683.png)Advanced file management systems ## **Advanced File Management Systems** Motornyuk’s work on comprehensive [file management](https://ckan.org/blog/ckan-updates-2025-sergey-motornyuk-performance-ui#:~:text=New%20file%20management%20flow%20and%20resumable%20uploads) systems has elevated CKAN’s capabilities to enterprise-level standards. By treating files as first-class entities with detailed metadata and version history, organizations now have better tracking, audit trails, and sharing flexibility. The support for resumable uploads and multi-cloud storage addresses real-world challenges like unstable connections and heterogeneous infrastructure. ## **15x faster: CKAN 2.12 to revolutionise large dataset downloads** Working with one of our developers, [Yan Rudenko](https://www.linkedin.com/in/yan-rudenko-03783a112/), Ward was also central to changes that will be available in the next version of CKAN – 2.12 – which will deliver a 15x performance boost to large data downloads on CKAN. [You can read about this significant development on our site here.](https://linkdigital.com.au/news/2025/11/ckan-2-12-faster-search-large-dataset-downloads/) ## **Keep your CKAN healthy!** Yan Rudenko developed [ckanext-selfinfo](https://github.com/DataShades/ckanext-selfinfo), a comprehensive administrative extension to take CKAN portal management to a whole new level. It provides a variety of capabilities for administrators to address and resolve issues quickly, ultimately improving service delivery. In the latest version of this tool, a new lightweight tracking system has been introduced to replace traditional Google Analytics. With increasing legal restrictions on sharing user data with external systems, in‑house tracking provides a safer approach. This system also opens new opportunities for enhancing user experience, allowing us to display informative metrics on the homepage, datasets, and other areas of the portal. [Watch: ckanext-selfinfo | Real time system info and error tracking for CKAN](https://youtu.be/D7VDe2R1SmI?t=2479) ## **New search functionality** Mercader’s enhancements to CKAN’s search functionality will allow choosing the search backend and searching across different CKAN entities in the next CKAN major version. He has also worked on improved Metadata interoperability that includes support for Dataset Series in [ckanext-dcat ](https://github.com/ckan/ckanext-dcat)and support for the ML Commons Croissant standard. Croissant is a metadata format for machine learning (ML) datasets that combines information about the dataset metadata, its resources, and data structure to make existing datasets more discoverable and interoperable across different tools. Also read: [Bridging CKAN and Machine Learning: Introducing Support for the Croissant Standard](https://ckan.org/blog/bridging-ckan-and-machine-learning-introducing-support-for-the-croissant-standard) ## **Platform integration and visual innovation** [Sergey Shchedrin](https://www.linkedin.com/in/sergii-shchedrin-04a958a4/?originalSubdomain=pl&skipRedirect=true&originalSubdomain=pl) has developed the CKAN Sync for Drupal module, enabling seamless integration between CKAN and Drupal platforms via RESTful API. This breakthrough represents an exciting advancement in maximizing the native interoperability between two acknowledged Digital Public Goods, enabling organizations to deliver sophisticated and interactive data sharing applications that combine the best of both platforms. [Read more about CKAN Sync for Drupal here.](https://linkdigital.com.au/news/2024/04/link-digital-makes-new-ckan-sync-for-drupal-module-available-to-open-source-community/) Cherniavskyi has been a major contributor to CKAN’s extension ecosystem with several groundbreaking developments. His [ckanext-blocksmith](https://github.com/DataShades/ckanext-blocksmith) brings drag-and-drop page building capabilities to CKAN using the [GrapesJS framework](https://grapesjs.com/), empowering non-developers to create engaging, data-driven pages with modular content blocks. ![ckanext-blocksmith - CKAN extension by Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/11/Screenshot-2025-11-12-at-10.40.24-AM-1-1024x652.png) Additionally, Cherniavskyi has been one of the top contributors, alongside CKAN expert [Tome Petrovski](https://www.linkedin.com/in/tome-petrovski-0553261b6/?skipRedirect=true), to [ckanext-charts](https://github.com/DataShades/ckanext-charts) over the past two years, building upon the foundation initially created by Motornyuk [during Link Digital’s work with Médecins Sans Frontières/Doctors Without Borders](https://linkdigital.com.au/case-studies/medecins-sans-frontieres-data-sharing-portal/). With Cherniavskyi’s work, this extension has evolved to enable data managers to create, edit, embed, and share interactive charts directly from tabular datasets, providing dynamic visualizations that enhance data interaction and presentation. ## **Developer accessibility and education** [Brett Jones](https://www.linkedin.com/in/brett-jones-49369b8/?originalSubdomain=de&skipRedirect=true&originalSubdomain=de) has championed CKAN development accessibility through his [GitHub Codespaces ](https://youtu.be/KGTyX3Nx9IU)demonstrations, enabling browser-based development and removing traditional setup barriers. His comprehensive installation walkthroughs have become essential community resources. You can [view these demonstrations here](https://www.youtube.com/playlist?list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx) on Link Digital’s Youtube channel. ## **A new GeoPackage Extension for CKAN** One of Link Digital’s standout achievements of 2025 has been Link Digital’s advancement of GIS-capable data portals. Our comprehensive approach to geospatial data management has enabled organisations to create online repositories that efficiently catalogue and share geographic information both internally and externally. The latest of these is a new extension to enable the viewing of GeoPackages in CKAN, developed by our Canadian subsidiary, Datashades Ltd., in the process of working on the [Quebec Regional Transport Authority Data Platform](https://www.artm.quebec/). Referred to locally as the Autorité régionale de transport métropolitain, ARTM is the government transportation authority that plans, finances, and integrates public transport in Greater Montreal in Quebec, Canada. A GeoPackage is a file format that enables the design and viewing of maps with layers, a GeoPackage. [You can read how Link Digital improved how the ARTM was able to improve CKAN’s functionality to view GeoPackages here.](https://linkdigital.com.au/news/2025/06/introducing-link-digitals-new-geopackage-extension-for-ckan/) ## **A year of transformative impact** Link Digital’s global team of CKAN experts have delivered remarkable value throughout 2025, combining technical excellence with deep understanding of organisational needs. Their contributions have not only advanced the CKAN platform itself but have also empowered organisations worldwide to unlock the full potential of data. From amazing user experience improvements to advanced search capabilities, and comprehensive file management systems to sophisticated geospatial solutions, Link Digital’s expertise has been instrumental in shaping the future of data management. Link Digital’s commitment to avoiding vendor lock-in and maximizing data interoperability ensures that organizations can build sustainable, long-term data management solutions that grow with their needs. --- *Ready to upgrade your data management capabilities? [Contact Link Digital ](https://linkdigital.com.au/get-in-touch/)to discover how their expertise can benefit your organization.* **Categories:** All articles, CKAN, DCAT (Data Catalog Vocabulary), Digital Public Infrastructure, Environmental/Climate Change, Geospatial, Internal data hub, Open Data, Technology Infrastructure, Topics **Tags:** CKAN --- ### [Introducing Link Digital’s New GeoPackage Extension for CKAN](https://linkdigital.com.au/news/2025/06/introducing-link-digitals-new-geopackage-extension-for-ckan/) **Published:** June 24, 2025 **Author:** Andrew Nette **Excerpt:** CKAN extension - GeoPackage JavaScript implementation by Link Digital **Content:** *This blog post is co-authored by Lex Du Plessis, Technical Delivery Manager at Link Digital.* The latest of these, a new extension to enable the viewing of GeoPackages in CKAN, was developed by our Canadian subsidiary, Datashades Ltd., in the process of working on the [Quebec Regional Transport Authority Data Platform](https://www.artm.quebec/). Referred to locally as the Autorité régionale de transport métropolitain, ARTM is the government transportation authority that plans, finances, and integrates public transport in Greater Montreal in Quebec, Canada. The project, still under development, involves the establishment of a public data hub and an internal data catalogue, enhancing data management and accessibility for public visitors, authenticated data consumers, and ARTM staff. Let’s take a very quick look at the new extension and the functionality it adds to CKAN. ## Improving GeoPackage viewing in CKAN Defined most simply, a GeoPackage is a file format that enables the design and viewing of maps with layers. This can include vector features – the representation of an object or data point as a collection of numerical values – and raster tiles – a pre-rendered image used to display maps on the internet and the connected attributes. The maps can be accessed, visualised and analysed in Geographic Information System software designed to capture, store, manage and present all types of geospatial data, and make them viewable on desktops, websites, and mobile devices or, for the purposes of the ARTM, in an internal data catalogue or open data portal. GeoPackage files can also support advanced features like spatial indexes and metadata for efficient management and querying. Widely used in urban planning and environmental management, GeoPackage files enable data managers to efficiently combine multiple geospatial data types into a single file. They are interoperable with other databases and web services and can easily handle large datasets. For data users, GeoPackage files deliver a richer data experience, enabling them to undertake queries and investigate relationships between different geospatial features, giving them a better overview of the subject in question and how their question relates to a larger geographic context. The ARTM team were looking to view GeoPackages in the portal, but CKAN’s existing functionality was limited in this regard and there was no good extension to enable this capability. It was then that we hit on the idea of using the official GeoPackage JavaScript implementation on the [OGC GeoPackage](https://www.ogc.org/standards/geopackage/) to develop a new extension, *[ckanext-gpkg-view](https://github.com/DataShades/ckanext-gpkg-view)*. This enables a simple preview for GeoPackage files in CKAN. ![CKAN extension - GeoPackage JavaScript implementation by Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/06/An-example-of-a-GeoPackage-map--1024x600.png)*An example of a Geopackage* ## Improving CKAN’s dataset series extension Delivering added functionality in relation to GeoPackages was not the only benefit for CKAN to come out of the ARTM project. Link Digital also used it to help develop and improve the [CKAN Dataset series extension](https://github.com/ckan/ckanext-dataset-series). Dataset series basically relate to any group of datasets that share a common characteristic, whether it be data structure, scope, geographic domain, etc. Dataset series can be ordered or unordered. If ordered they follow a list and there is a first and last item of the series, plus next and previous datasets for individual members. Dataset Series are well supported in CKAN. *Ckanext-data-series* provides a fast and lightweight underlying implementation, including the API and UI for publishers to manage a dataset’s series and its members. *Ckanext-dcat* provides seamless integration to expose these dataset series to other catalogs and systems in a DCAT compliant way. Link Digital used the ARTM project, as an opportunity to make the extension more production-ready by building the missing UI bits, namely form snippets to let publishers know which series a dataset belongs to and configure the dataset series themselves, as well as a navigation UI in the dataset page of a dataset series member pointing to the previous and next datasets in the series. It means, for example, that if you are looking at the 2024 budget for something, you can easily jump to the 2023 or 2025 ones (the previous and next ones on the series). ## Benefitting the whole CKAN community The best thing about both the GeoPackage extension and the improvements to the dataset series extension that have come out of the ARTM project, is that they represent added functionality that will be available for the entire CKAN community. As a CKAN co-steward, giving back to the community around the software is not only core business. It is something that gives us great satisfaction. **Want to build a CKAN-powered open data portal or internal data catalogue?** [Contact us](https://linkdigital.com.au/get-in-touch) and one of our experts will be in touch. - [Facebook](https://www.facebook.com/LinkDigital) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/) **Categories:** All articles, CKAN, Environmental/Climate Change, Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Industry, Smart City, Technology Infrastructure, Topics **Tags:** CKAN, GeoPackages --- ### [Guard rails and algorithmic transparency in the race by governments to adopt artificial intelligence](https://linkdigital.com.au/news/2025/11/transparency-in-the-race-by-governments-to-adopt-artificial-intelligence/) **Published:** November 12, 2025 **Author:** Andrew Nette **Excerpt:** A snapshot of the main discussions at the Open Government Partnerships Summit 2025 around AI use in government services. Read more. **Content:** *This is the second in a series of articles on the* [*Open Government Partnership Summit 2025*](https://www.opengovpartnership.org/events/2025-ogp-global-summit/)*, in Vitoria-Gasteiz, Spain, in October. Technical Writer/Analyst* [*Andrew Nette*](https://www.linkedin.com/in/andrew-nette-9780a4266/?miniProfileUrn=urn%253Ali%253Afs_miniProfile%253AACoAAEEnKmwBauWuHRdrdS8uNElh2NnYzIh3tVU&skipRedirect=true&miniProfileUrn=urn%3Ali%3Afs_miniProfile%3AACoAAEEnKmwBauWuHRdrdS8uNElh2NnYzIh3tVU) *was one of the Link Digital staff present at the event.* The topic that most dominated discussions at the Open Government Partnership (OGP) Summit 2025 was AI. Not surprisingly, given the diversity of those present – everyone from government officials of major developed countries to civil society representatives from the Global South – the conversation veered across a range of viewpoints. From AI as a major threat to democracy and open government, to being a possible way for governments to work better and provide improved services for citizens. It’s a topic that is of core interest to Link Digital, given the increasing implications of AI for the work we do globally in open data and digital public infrastructure. But it is also important far more generally in terms of [what AI means](https://linkdigital.com.au/news/2023/09/good-data-for-artificial-intelligence-what-does-it-mean-and-how-can-we-get-it/) in terms of what a sustainable system of social cohesion might mean for democracies going forward. The following article presents a snapshot of the main discussions at the OGP around AI use in government services. ## **What exactly are we debating?** AI is a series of fast evolving technologies that comprise everything from very narrow, task specific forms to deep learning models that allow AI applications to learn how to perform tasks that require human intelligence level abilities and decision making capabilities. But mirroring debate around the tech more generally, most discussion at the OGP tended to obscure the differences between the technology. As [Adrià Mercader](https://amercader.net/ "Adrià Mercader"), Link Digital’s Senior Solutions Architect, who was also at the OGP Summit, observed: > There is constant bombardment of AI discourse around potential uses and major disruptions AI will cause, and there are massive economic interests behind this hype. This makes it very difficult to assess the technology purely on its merits, first because it is a fairly technical field that is evolving very fast, but also because it can mean very different things. People tend to associate AI with large language models like ChatGPT. But AI also encompasses many other technologies like Image Recognition, Semantic Search, Natural Language Processing etc. In this context it is really easy to overestimate the capabilities or accuracy of current AI technologies while at the same time minimize the risks or biases involved. There is a massive need to increase literacy in this field, of course alongside data and more wider technological literacy. A related point was made during the Summit by [Patricio ](https://www.linkedin.com/in/patriciodelboca/?skipRedirect=true)[Del](https://www.linkedin.com/in/patriciodelboca/?skipRedirect=true)[ Boca](https://www.linkedin.com/in/patriciodelboca/?skipRedirect=true),Tech Lead at [Open Knowledge Foundation](https://okfn.org/en/). He noted there have been waves of AI, starting in earnest around 2103 with the advent of basic machine learning models, followed by a wave of predictive AI and now generative AI. > AI is just like a tool and how we have used it has shifted over time and will continue to do so. But the OGP is not a forum for technological discussion but one that focuses on the political and social uses and impacts of digital technologies like AI. As part of this, participants tried to tackle the contrast between AI which is fast moving and fluid, and government structures that can be rigid and slow to respond to change. ## **Governments adopting AI at a rapid rate** What was clear from the Summit is governments in both developed countries and in the Global South, are already increasingly utilising AI in many of its forms. This is happening on two levels: civil servants using the technology in their individual work; and governments adopting AI to automate/semi-automate government processes and public facing services. Ecuador is one of many Global South countries racing to adopt AI to close the gap between citizens and government services. Juan Francois Román, Ecuador’s Under-Secretary of Government Management, made an explicit link between democratic crisis and lack of responsive services in the decision to incorporate an AI-powered chatbot on the national government’s open data portal. He argued this will enable citizens to ask a question and get a faster, more reliable response. He also hoped that it would help open the data hosted on the portal beyond data experts and to a wider section of the public. > Government is slow, and citizens want quick, almost real time answers, to their questions and will shop around for the data they need to meet needs and exercise rights. Creating a digital assistant could be a good tool to help citizens and have a real time conversation with citizens. [Professor Beth Noveck](https://thegovlab.org/beth-simone-noveck.html) from Illinois’s [Northeastern University](https://www.northeastern.edu/), noted the extensive use of AI by state governments in the US; everything from helping to simplify law drafting, and monitoring state government procurement, to being more responsive to questions from citizens. Like Ecuador’s Román, she also drew a link between AI adoption and strengthening democracy. > It \[AI\] is giving us the tools to accelerate what we have always wanted to do. The key question is who do we govern with AI? It can make government work better for people and is a way of pushing back against anti-democratic views. More pressing for Noveck is how to train civil servants to use AI more efficiently and responsively. This was part of a much larger question debated at the Summit: what are the guardrails for AI’s use and how do governments monitor what they do with the technologies to make sure it is transparent and citizen centric? Estonia is taking a multi-stakeholder approach, with the central government working with the education department and private enterprise to roll out an AI teaching aid that will be implemented across the school system. > AI is here in our everyday lives and governments must decide how to make the best use of it, said Estonian Secretary of State Keit Kasemets. > The reality is that we need to speed up and make decisions more quickly and AI can help us do this. ## **The need for algorithmic transparency** One voice at the Summit that was highly critical of the way AI is being adopted by governments was [María Paz Hermosilla](http://linkedin.com/in/mphermosilla?originalSubdomain=cl), Director of [GobLab at Chile’s Universidad Adolfo Ibáñez](https://goblab.uai.cl/en/). The use of AI by most governments, she stressed, is opaque and lacks any kind of transparency in algorithmic transparency or accountability. Most systems use personal data, but we do not know any details. > In low risk settings I welcome AI intervention. In high risk areas there is a need for more testing. Governments should go for low risk fruit, and take more time in higher risk areas like health. We need much more testing before these things become laws. GobLab has mapped approximately 700 instances in which AI has been used in government service provision in Latin America alone, most of which have virtually no public data about them or standards of algorithmic transparency. Hermosilla argued there was a pressing need for algorithmic registers that go beyond the actual description and code of the algorithm being used in a particular government service, to answering questions such: - Why the AI algorithm in question was implemented in the first place - Does it use personal data and if so what - How is the system audited - What is the implementing agency and who is the actual human point of contact to learn more. Hermosilla argued these registers need to be publicly available and legally enforceable. > The use of AI by governments needs to be routinely monitored just like other government services, particularly in relation to important services. While several countries present at the Summit had undertaken such initiatives, the gold standard is Canada. According to [Dominic Rochon, Chief Information Officer for the Treasury Board of Canada Secretariat](https://www.canada.ca/en/treasury-board-secretariat/corporate/mandate/chief-information-officer.html), any Canadian agency that wants to adopt an automated decision system using AI needs to perform an [Algorithm Impact Assessment](https://www.canada.ca/en/government/system/digital-government/digital-government-innovations/responsible-use-ai/algorithmic-impact-assessment.html), not only during the design phase but also during the implementation and once deployed. Introduced in 2019, this assessment tool has already been reviewed four times. > The challenge is how to achieve the right balance between adoption and responsible use.” Every agency must have an AI team, and all assessments are publicly available on an open data portal. Rochon claimed that while the process comes with challenges, including the complexity of the assessment process and the burden it puts on teams, it has brought an increase of accountability and collaboration around AI use. But, of course, not every government has Canada’s resources. Smaller and less developed countries especially face constraints monitoring AI use, including the lack of a specific administrative function in their government to regulate AI usage. Language is another consideration. Government representatives from Estonia and Armenia reported making a major effort to create local language AI models. [Leonida Mutuka, AI Research Lead for the Kenyan-based Local Development Research Institute](https://datafest.africa/speaker/leonida-mutuku/), stressed that Africa needs local talent who are trained in how to use it and work with AI, including how to deal effectively with issues like bias and ensure AI effectively reflects African context. ## **Conclusion** While the OGP Summit 2025 provided no neat conclusion to the issues around governments’ increasing use of AI, there were some takeaways from the meeting that struck me as important. First, AI must be used to make governments better, not just busier and more efficient. Several speakers stressed that there is no point using AI as part of digitising services that already don’t work. The point is to use AI to build improved services that the public wants. While AI is good at doing certain things at scale and might help with repetitive tasks, it won’t be able to help with underlying issues in government services like underfunding, lack of transparency, etc. Citizens might be understandably wary of AI technology applied to public services so again, full transparency is critical here. Second, while there was a lot of discussion on the ongoing importance of open data in developing transparent and citizen centric uses of AI in government, it felt like only a few voices stressed the ongoing importance of a role for the OGP in continuing to support governments to invest in building their own tools to open up more data and make it more interoperable, etc. As [Ricardo Miron Torres](https://www.linkedin.com/in/ricardomiron/?originalSubdomain=mx&skipRedirect=true&originalSubdomain=mx), Chief Technical Officer at the [Digital Public Goods Alliance](https://www.digitalpublicgoods.net/), put it: > OGP has made considerable progress on open data for the last 10-15 years. We should not throw out these principles in the rush to adopt AI. The discussions around open data at the OGP will be the subject of my third and final report from the 2025 Summit. ***Also read:*** [*A look at some of the key debates around Digital Public Infrastructure at the Open Government Partnership Summit 2025*](https://linkdigital.com.au/news/2025/10/what-is-digital-public-infrastructure-and-can-it-help-reverse-the-decline-in-public-trust-in-government/) **Categories:** All articles, Artificial Intelligence, CKAN, Digital Public Infrastructure, Government, Open Data **Tags:** algorithmic transparency, Artificial intelligence, digital public goods, open data --- ### [DCAT: why is it important for data catalogues and open data portals?](https://linkdigital.com.au/news/2024/09/what-is-dcat-and-why-is-it-important-for-data-catalogs-and-open-data-portals/) **Published:** August 18, 2025 **Author:** Andrew Nette **Excerpt:** Both DCAT and CKAN are designed to support the management and publication of open data. CKAN aligns with DCAT in several important ways. **Content:** Earlier this year, Link Digital[ announced funding for a new initiative ](https://linkdigital.com.au/news/2024/07/link-digital-to-establish-beneficiary-fund-for-digital-public-goods/)to enhance the core capabilities and reach of CKAN – the Comprehensive Knowledge Archive Network. A major focus of this initiative has involved an extensive rewrite of one of CKAN’s key extensions, [ckanext-DCAT](https://docs.ckan.org/projects/ckanext-dcat/en/latest/changelog/). This has enabled easier use, deeper customisation, and greater support for the latest version of DCAT and its various profiles, such as [DCAT-AP](https://semiceu.github.io/DCAT-AP/releases/3.0.0/), the European Union’s DCAT profile, and [DCAT-US](https://doi-do.github.io/dcat-us/), the DCAT profile for the United States. ## **What is DCAT?** But what exactly is DCAT, why are we excited about enhanced CKAN-DCAT compatibility, and why should those working on data catalogs and open data portals be paying attention to it? DCAT or Data Catalog Vocabulary, is [a World Wide Web (W3C)](https://www.w3.org/) recommendation designed to facilitate interoperability between data published on the web, for example, in open data catalogues or public facing data portals. DCAT uses what is called Resource Description Framework—a standard model for data interchange on the web—to enable a data publisher to describe datasets and data services using a standard model and vocabulary. This makes data catalogues and portals more readable by a wider range of applications in such a way as to make the data on them more discoverable and reusable. The first official iteration of DCAT, DCAT Version 1, originated in early 2014 out of discussions about how to make data less prone to being siloed and more findable by humans and machines. This led to working on a method to allow data providers to describe their datasets in a standard way that can be understood by different data catalogues and portals in different parts of the world, to facilitate greater interoperability between them. The latest version is DCAT 3, introduced in 2022. ## **DCAT and the European Union** ### How does the EU utilize DCAT to improve data sharing across member states? The EU has developed the DCAT Application Profile (DCAT-AP) to standardise how metadata about public sector datasets is published across European data portals. This standardisation enhances interoperability, making it easier for these portals to communicate and integrate, thereby supporting the European Data Strategy and the creation of Common European Data Spaces. ### Are there any countries outside of Europe, the US, and Canada adopting DCAT, and what challenges do they face? Some countries like China and India have not formally adopted DCAT and are developing their own data standards. Challenges include varying metadata elements, lack of provenance schemes, and different visions for digital standards, which can hinder seamless interoperability on a global scale. ### What is DCAT and why is it important for data interoperability? DCAT has assumed particular importance in the context of the European Union (EU), where there are many nation states with an even larger number of different government public data portals, all of which have their own governance frameworks. The need for public sector data to be searchable and discoverable across these different geographic, administrative and legal jurisdictions makes interoperability between these portals a high priority. The 2020 document [*Towards a European Strategy on Business to Government Data Sharing for the public interest*](https://op.europa.eu/en/publication-detail/-/publication/d96edc29-70fd-11eb-9ac9-01aa75ed71a1) states the challenge thus: ‘With the continuously growing amount of data, interoperability is increasingly a key issue in exploiting its full value when combining data from different data sources, reusing it for multiple purposes and across sectors.’[\[1\]](#_ftn1) While DCAT has been developed as a general standard, it is designed to enable users to build what are known as profiles to make it more applicable to a specific geographic region or to a domain subject.The EU has developed its own profile for European data portals known as DCAT Application Profile or DCAT-AP. It is designed to help standardise how metadata about public sector datasets is published in Europe, with the aim of making it easier for different European data portals to talk and better integrate with each other. Economic and trade development are key factors driving the EU’s uptake of DCAT, particularly the need to create a single market for data to ensure Europe’s global competitiveness. But creating a set of common standards is also aimed at enhancing the user experience by making data sharing more efficient and streamlining data management. In addition, DCAT is key to what is known as [*The European Data Strategy 2020*](https://digital-strategy.ec.europa.eu/en/policies/strategy-data) and the creation of [Common European Data Spaces](https://digital-strategy.ec.europa.eu/en/policies/data-spaces) in which there will be a more robust attempt by governments to balance the need to make data more easily discoverable and shared, with balancing privacy and security concerns for business and individuals. ## **DCAT across the rest of the world** Another country to develop its own specific DCAT profile is the United States. This profile, DCAT-US, is used to standardise metadata across the datasets published by the government’s national open data portal, [Data.gov](https://data.gov/). Canada is another country that has adopted DCAT and uses it to structure and standardise metadata across all its data platforms But while DCAT may be the closest thing that currently exists to a worldwide metadata standard it is by no means universally accepted. Even within the EU there are many public organisations that prefer their own metadata standards to DCAT. Moving away from Europe, the United States and Canada, it is also an unresolved question what standard, if any, will become dominant, as governments in China and India have very different visions for their own digital future.[\[2\]](#_ftn2) China has not officially adopted DCAT and appears to be pushing ahead with developing its own profiles and standards for the data management of its open government data (OGD) portals. ‘However, these metadata elements in different OGD portals vary and there is no specific and well-defined provenance description scheme for OGD in China.’[\[3\]](#_ftn3) India has also not formally adopted DCAT as a national standard, although it does engage in data management practices that have elements of alignment with DCAT. ## **Australia and DCAT** Australia has what can be described as a very limited uptake of DCAT. The Australian Government’s 2015 [*Public Data Policy Statement*](https://www.finance.gov.au/sites/default/files/2022-10/aust_govt_public_data_policy_statement.pdf), a foundational document in terms of its directions in the data and digital space, encourages data sharing and accessibility, which broadly aligns it with DCAT’s intent. The national open data platform, [data.gov.au](https://data.gov.au/), uses the DCAT standard to describe datasets, although it is not clear whether this is uniformly applied across state and territory data portals. The [Australian Government Record Keeping Metadata Standard](https://www.naa.gov.au/information-management/standards/australian-government-recordkeeping-metadata-standard) also incorporates some DCAT-compliant principles. And some Australian universities and government bodies use DCAT and its extensions for better integration of data catalogs across different subjects and research datasets. Australia is a relatively small player in the global data and digital space and lacks the geographical and legal jurisdiction diversity of Europe. But while aligning more with DCAT standards may not create immediate value for Australian data catalogues and open data portals, there are nonetheless significant benefits that could flow to us from adopting a more robust DCAT adherence. Foremost of these are returns in terms of our international trade. Ensuring that Australia is using a common standard for our data will help those researching potential commercial opportunities in Australia, foster innovation, and could facilitate investment. One standard for metadata avoids costly crosswalks – the mapping of specific elements in one metadata standard to those in another standard – between data sets. This will save overseas researchers from different jurisdictions time and ensure that Australian datasets can be combined in whatever work they are doing without extensive reformatting or transformation and vice versa. Along with the increased discoverability of datasets on public data portals, this will promote global engagement in terms of research and cross border policy initiatives. If a researcher at an American university, for example, wants to harvest data from an Australian data portal, they will have a much easier time if the portal has a DCAT compliant version of its metadata. Diplomatically, greater interoperability between Australian data catalogs and portals and those in other national jurisdictions also helps to align us with an open, democratic and inclusive data culture ## **Conclusion** Both DCAT and CKAN are designed to support the management and publication of open data. CKAN aligns with DCAT in several important ways. For example, the [ckanext-DCAT](https://docs.ckan.org/projects/ckanext-dcat/en/latest/changelog/) extension mentioned at the opening of this post allows CKAN to export and publish its metadata in DCAT format and enables CKAN-based data catalogs to be integrated with other data catalogs or platforms that use DCAT metadata. It also enables CKAN users to easily define and create their own DCAT application profiles. ## **Get in touch** If your organisation is interested in exploring how a CKAN open data catalog or portal can be integrated with efforts to standardise your data with DCAT, [contact us](https://linkdigital.com.au/get-in-touch/) and tell us about your project. --- [\[1\]](#_ftnref1) European Commission: Directorate-General for Communications Networks, Content and Technology, *Towards a European strategy on business-to-government data sharing for the public interest – Final report prepared by the High-Level Expert Group on Business-to-Government Data Sharing*, Publications Office, page 65, 2020, [\[2\]](#_ftnref2) Gordon LaForge and Patricia Gruver, *Governing the Digital Future*, New America, October 2023, page 65, [\[3\]](#_ftnref3) Chunqiu Li, Yuhan Zhou, and Kun Huang, 2019, ‘A Survey of Metadata Elements for Provenance Provision in China Open Government Data Portals,’ paper presented at International Conference on Dublin Core and Metadata Applications, Seoul, South Korea, September 23-25, 2019, ACM Digital Library [https://dl.acm.org/doi/abs/10.5555/3379957.3379968](https://dl.acm.org/doi/proceedings/10.5555/3379957) **Categories:** All articles, CKAN, DCAT (Data Catalog Vocabulary), Government, Higher Education/Research, Internal data hub, Open Data **Tags:** CKAN, DCAT --- ### [Open Data Meets Research Data at IDW2025](https://linkdigital.com.au/news/2025/10/open-data-meets-research-data-at-idw2025/) **Published:** October 29, 2025 **Author:** Steven De Costa **Excerpt:** What I took away from IDW 2025 was a clearer sense of the reciprocity between the open data and research data communities. Each has something profound to teach the other. **Content:** Two weeks ago, I attended [International Data Week (IDW) 2025 in Brisbane,](https://idw2025.org/) which was my first time at this remarkable global gathering. Although I’ve been to plenty of technical, open-source, open-government, and community-driven conferences, this one was something different. Here, the conversations were rooted in the scientific method, in the philosophy of knowledge, and in the artful, practical, and theoretical use of data for research that truly matters on a global scale. ![Open Data Meets Research Data at IDW2025](https://linkdigital.com.au/wp-content/uploads/2025/10/IMG_2162-1-scaled-1024x768.jpg)Steven De Costa, Chairman, Link Digital (left) Scott Lingard, Chief Revenue Officer, Link Digital (right) ## **Why I went** What drew me to IDW wasn’t only the impressive program of speakers and panels (though there were many). It was my own drive to bring more research and method-oriented value into the data capabilities we deliver at Link Digital. That is, to strengthen the confidence our clients have in their data in an era where AI, cybersecurity, and social cohesion increasingly overlap. In global terms, we’re in what many call a [polycrisis](https://linkdigital.com.au/news/2025/06/public-governance-in-a-time-of-polycrisis-what-i-learnt-from-berlins-creative-bureaucracy-festival/), where multiple interconnected disruptions are challenging the ways societies govern, share, and trust information. I came to IDW with a sense that a similar polycrisis exists within the open data movement itself: a crisis of coherence and purpose in how we use openness as a driver of innovation, transparency, and social contracting across the many economies of knowledge and sharing. ## **What I learned** What I took away from IDW 2025 was a clearer sense of the reciprocity between the open data and research data communities. Each has something profound to teach the other. - The open data community must look back to the fundamentals of knowledge practice. When we make programs, initiatives, and systems of information “open,” we should do so as part of a deeper hypothesis and situate this as part of a living experiment to discover and demonstrate objective value from our public data initiatives. - The research data community, in turn, must look beyond methodological rigor and peer-review survivorship to the fundamentals of value. Research must consider its civic and social worth and situate this as part of a value chain of shared understanding, trust, and progress beyond its own disciplinary boundaries. ## **A shared horizon** Leaving IDW, I was convinced that civics, citizenship, knowledge, and agreement need to converge. Only through this convergence can a new grand practice emerge, something akin to a new enlightenment. Our complex challenges are living, informational mosaics which require data practitioners that integrate the openness and transparency of the civic world with the methodological precision of the research world. The bridge between the two isn’t just data, it’s **trust, method, and meaning** working together. **Categories:** All articles, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** Thought Leadership --- ### [Pacific Dataviz Challenge: Telling stories with data](https://linkdigital.com.au/news/2025/10/pacific-dataviz-challenge-telling-stories-with-data/) **Published:** October 28, 2025 **Author:** Andrew Nette **Excerpt:** Making extensive use of datasets held on the Hub as the basis for the Challenge, is just one of many examples of the real world impact that the site is having. **Content:** At Link Digital, we don’t just derive satisfaction from building open data projects for clients. We enjoy watching the projects that we’ve worked on mature and become active players in their data ecosystems. One of these projects is the [Pacific Data Hub](https://pacificdata.org/). Built by [Link Digital](http://linkdigital.com.au/) for the [Pacific Community (SPC)](https://www.spc.int/), the principal scientific and technical organisation for the Pacific, the Hub was launched in late 2020 and serves as a gateway to the most comprehensive data collection of relevance to the 22 Pacific Island nations and territories. The Hub is an excellent example of how a CKAN – [Comprehensive Knowledge Archive Network](https://ckan.org/) – open data portal can support evidence-based research and informed policy development. But not only does it provide timely, high-quality data to enable the creation of more informed and ‘Pacific-centric’ solutions, it also functions to improve data collection, capacity and literary across the region. Which is why the [Pacific Dataviz Challenge](https://pacificdatavizchallenge.org/) is so exciting to witness. The competition encourages people – regardless of age, location, background and skill level – to experiment with storytelling, design, innovation and technical skill in the visualisation of Pacific related data. And most recent Challenge, the fourth time that it was held, was the most successful yet. ## What is a dataviz challenge? A dataviz encourages participants to use data visualisation to transform raw numbers visually into graphs, maps, charts, or other visual forms, to help tell a story in terms of trends, patters and relationships within the data. Those taking part in the Pacific Dataviz Challenge are free to use any data visualisation tool, but they must use at least one dataset from the official list of hosted on the Hub. Participants are also free to incorporate other datasets from the [Hub](https://pacificdata.org/), or any other source of open data, i.e., data that are publicly available to anyone for any purpose. Over time, the Challenge has grown. The 2025 Challenge drew 148 participants, a 50% challenge from last year’s event, with half of them living in the Pacific. Students, teachers, and professionals from across the Pacific are now using the platform to tell their own data stories. Several schools and universities have even integrated the Challenge into their curriculum. According to Léo Cann-Polydor, Statistics Analyst at the Pacific Community: > We’ve seen a growing number of young people taking part each year, and more women and girls are participating too. This year, more than half of participants were under 26, reflecting the next generation’s enthusiasm for using data as a tool for change. Sixty per cent of participants were women and girls, notable in a STEM field. This demonstrates that data literacy across the Pacific is improving – more people are learning to understand, analyse, and communicate data effectively. ## Telling Pacific stories with data The Challenge began as an initiative to promote the Hub and encourage the use of data and statistics across the region. The goal was to make data more accessible, engaging, and relevant to everyday life, by inviting participants to use regional open data in transforming complex statistical indicators into visual insights and interactivity, highlighting the region’s potential as well as its pressing challenges. The theme of the 2025 Challenge was based around the [*Blue Pacific 2050 Strategy*](https://forumsec.org/2050), developed by the [Pacific Island’s Forum](https://forumsec.org/). This frames a long-term joint regional approach to several key thematic areas, including people centred development, security, resource and economic development, climate change, ocean and Environment and technology. Storytelling is at the heart of Pacific culture, and with the Blue Pacific 2050 theme, participants were encouraged to raise awareness and inspire reflection on regional challenges. As Manaini Rokovunisei, 2050 Team Leader at the Pacific Islands Forum, put it: > Now more than ever, we must act together guided by science, tradition and solidarity. I’m excited to see data visualisation used through the Pacific Dataviz Challenge to tell stories, raise awareness and inspire change. The Challenge attracts top talent from across the Pacific and beyond, creating opportunities for young participants to connect with experienced mentors. Many submissions focused on climate change, demonstrating how participants use data to educate, challenge perspectives, and inspire action for a more sustainable Pacific future. The full list of prize winners and the topics they covered can be seen in the awards ceremony, [available to watch in full on the Challenge’s YouTube channel.](https://www.youtube.com/@PacificDatavizChallenge) ## Real world impact Making extensive use of datasets held on the Hub as the basis for the Challenge, is just one of many examples of the real world impact that the site is having. According to Léo Cann-Polydor, Statistics Analyst at the Pacific Community, other examples include: - The [Blue Pacific 2050 Dashboard](https://blue-pacific-2050.pacificdata.org/people-centred-development), which has become a key reference for the region’s strategic framework and was co-developed with the Pacific Islands Forum Secretariat. - The International Court of Justice case on state responsibility for climate change, led by Vanuatu. Pacific nations sought an advisory opinion on countries’ obligations to protect the environment and the rights of future generations. Some of the data and reports used were drawn directly from the Pacific Data Hub. Malcolm Fraser, Programme Manager for the Pacific Data Hub, explains: > Good data, well communicated, can inspire change. The Pacific Dataviz Challenge is one way we’re helping to unlock the value of data across the region — supporting informed, evidence-led decisions, innovative thinking and a greater understanding of the Pacific context across a wide range of thematic areas. The Hub provides access to thousands of datasets across a range of subject areas, including population, trade, climate, education, and health, to support informed, evidence-based decision-making. It is also increasingly used for academic research and classroom learning, helping students connect what they learn to their own countries and realities. The Challenge is helping to realise the Hub’s vision of ‘Data for the Pacific, by the Pacific, from the Pacific.’ [*Read more about Link Digital’s work on the Pacific Data Hub here*](https://linkdigital.com.au/project/pacific-data-hub/)*.* *Also read:* [*More than just a data hub: an interview with Malcolm Fraser, Programme Manager, Pacific Data Hub*](https://linkdigital.com.au/news/2025/05/more-than-just-a-data-hub-an-interview-with-malcolm-fraser-programme-manager-pacific-data-hub/) **Categories:** All articles, CKAN, Digital Public Infrastructure, Environmental/Climate Change, Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** open data --- ### [Data meets community: Link Digital talks CKAN at csv,conf,v9 conference, Bologna, Italy](https://linkdigital.com.au/news/2025/10/data-meets-community-link-digital-talks-ckan-at-csvconfv9-conference-bologna-italy/) **Published:** October 2, 2025 **Author:** Andrew Nette **Content:** ![Data meets community: Link Digital talks CKAN at csv,conf,v9 conference, Bologna, Italy](https://linkdigital.com.au/wp-content/uploads/2025/09/Link-Digital-CKAN-workshop.jpg)*Photo by Daniela Popova* It is not that often that members of the CKAN community have the opportunity to get together in person. Which is why Link Digital was thrilled to be able to lead a special in-person workshop as part of the pre-conference events around the [csv,conf,v9 conference](https://csvconf.com/), in mid-September, in Bologna, Italy. The workshop welcomed participants from diverse backgrounds — not just developers, but also policymakers, librarians, researchers, and civic leaders — reflecting the spirit of csv,conf as a community-driven event focused on real-world impact According to [Ian Ward](https://www.linkedin.com/in/ianward/?originalSubdomain=ca) , who, along with [Adrià ](https://www.linkedin.com/in/adriamercader/)[Mercader](https://www.linkedin.com/in/adriamercader/) represented Link Digital at the gathering, csv.conf is different to a lot of ‘big data’ conferences that are dominated by vendors and sales people. > So much important work is done at a smaller scale: spreadsheets and data that can fit on a laptop. People attending csv,conf appreciate simple, accessible technologies like csv for interoperable data sharing and make up a great community. This year’s conference theme, ‘Data for Communities’, resonates deeply with Link Digital’s mission: building digital infrastructure that empowers governments, researchers, and communities to make data truly useful and usable. Which made it a perfect forum for Link Digital to talk about the [Comprehensive Knowledge Archive Network – CKAN](https://ckan.org/). In addition to a general overview of CKAN, the workshop included: - A roadmap and vision for CKAN’s future evolution, leading to the software’s next major release, CKAN 3.0. - Short presentations into features, deployments, and community initiatives. - An update on phase two of the [Pathways to Enable Open-Source Ecosystems or POSE project](https://civicdataecosystem.org/). This is focused on how the CKAN’s effectiveness as an open data platform could be strengthened, and the steps necessary to adequately support CKAN’s maintenance and ensure the needs of all users are integrated into technical modifications going forward. - A Q&A and breakout sessions with CKAN maintainers and contributors The in-person workshop will be soon available to watch in full on Link Digital’s YouTube channel. CKAN had a high profile elsewhere throughout the conference. > CKAN was mentioned multiple times in talks at the conferences, it was great to see the understanding of the importance of good metadata and data publishing tools,” Ian says. “CKAN has an opportunity to help deliver data interoperability and reusability especially in the growing areas of data use like machine learning. CKAN’s profile shows it is > a well-established and a critical part of the data ecosystem, Adrià commented. > During conversations throughout the conference the topic of having good quality data easily available came up time and time again, and I think that CKAN needs to be the reference tool to make that happen. Want to talk about CKAN? [Get in touch with the Link Digital team today](https://linkdigital.com.au/get-in-touch/). **Categories:** All articles, CKAN, Open Data **Tags:** Adria Mercader, Comprehensive Knowledge Archive Network, csv.conf.v9, Ian Ward --- ### [CKAN and Digital Object Identifiers (DOIs)](https://linkdigital.com.au/news/2020/08/ckan-and-digital-object-identifiers-dois/) **Published:** September 23, 2025 **Author:** Steven De Costa **Excerpt:** Many are wondering if CKAN can be extended to support DOIs… the short answer is, yes. **Content:** Commonly used by key players within the open data space including Government agencies, this powerful data management tool is increasingly used by research organisations. A growing number of public data portals are publishing, not only the data of public administration, but also research artifacts supporting public policy and programs. Government organisations that rely on scientific data (environment, geoscience, etc.) operate under workflows that have the features researchers use or value. One of these features relates to Digital Object Identifiers (DOIs). ## What is a DOI? A DOI refers to the persistent alphanumeric string used to identify datasets, research documents, and other specific output, including online articles. It’s a more preferred way of locating an online source due in large part to its reliability and permanence. The [International DOI Foundation](https://www.doi.org/) (IDF) handles the central database where the identifiers are stored. While a URL can often be changed or be decommissioned at any point, DOIs have been designed to be persistent. This means that anyone trying to cite a dataset or research document will never have issues with a broken link or a 404 error, as DOIs are a permanent reference to a digital object. ## Can CKAN support DOIs? Many are wondering if CKAN can be extended to support DOIs… the short answer is, absolutely. Using CKAN to support DOIs can be very helpful for many existing open Government data portals. [DataCite](https://www.datacite.org/) (a registration agency accredited by the IDF) provides the registration of DOI names for research data. This [CKAN extension](https://github.com/NaturalHistoryMuseum/ckanext-doi) assigns a DOI to datasets using the DataCite DOI service. ## How can a dataset be eligible for DOI minting? Typically, outputs should satisfy the following requirements: they must be unique, accessible, discoverable, immutable, citable and persistent. As an example, let’s look at the case in [Research Data Australia](https://researchdata.edu.au/). Research Data Australia is an online portal for the discovery of data collections from several Australian research organisations and Government agencies. It is a flagship [DOI service](https://www.ands.org.au/online-services/doi-service) offered by the Australian National Data Service (ANDS) – an entity that aims to make research data assets more valuable. The DOI service provided by ANDS is free for all publicly funded Australian Government agencies and research organisations. You can also opt to register for manual and machine-to-machine DOI minting. Still, to do so, you need to [register](https://documentation.ardc.edu.au/pages/viewpage.action?pageId=28868790) with the Australian Research Development Council (ARDC) for a DOI Service Account. Most organisations similar to ANDS that offer DOI minting services do not manage DOIs and only provide the infrastructure to allow minting. Organising processes and policies to guarantee appropriate maintenance practices to support persistence is still up to those using it. Before minting a DOI, there must be a publicly accessible landing page of a dataset that the DOI is pointing to. If the dataset or resource’s location is changed (e.g., another organisation takes ownership and moves it to a different portal), the DOI must be updated to ensure it’s pointing to the new location. ![DOI Minting Process - Link Digital ](https://linkdigital.com.au/wp-content/uploads/2020/08/ANDS-_-Data-Cite-1-1024x768.png)If a dataset location has changed, the DOI will not change as well but users can still access the datasets using the same DOI. Due to its permanence, the same DOI will persist in resolving the correct resources at their new locations – readily available for reuse and reference. ## DOI Create: IAR portal as a use-case The NSW Government’s Information Asset Register (IAR) portal provides searchable metadata and contact details for a list of core-value information assets, including datasets for the NSW Government. Link Digital has worked with the NSW Office of Environment and Heritage (OEH) (now Department of Planning, Industry, and Environment) to develop the capability for scientists to assign DOIs or Handles to selected research papers and datasets to allow more standardised participation in scientific communities and work to be cited with permanent URLs based on the DOIs. ![CKAN AND DOI - Link Digital](https://linkdigital.com.au/wp-content/uploads/2020/08/Frame-4.png)Link Digital used ANDS to mint the DOIs. The then OEH Science Division assisted us in getting access to required information for ANDS DOI Services and Handle Services. In doing so, we were able to achieve the following: - IAR has fields to supply all the required metadata for minting a DOI - The asset/dataset summary page on IAR and the SEED Open Data Portal displays the dataset DOI - The DOI resolves to the dataset summary page in the SEED Open Data Portal - Admin users are able to delete assets from the IAR and un-publish them from the SEED Open Data Portal. CKAN being extensible to support DOIs proves why the platform remains to be the standard when it comes to open data publishing. If your organisation is considering adopting CKAN for open research data, don’t hesitate to give this tool a try. ## ***Want to learn more about how CKAN can be used to support DOIs? Feel free to [get in touch](https://linkdigital.com.au/get-in-touch/) with the Link Digital team today.*** **Categories:** All articles, CKAN, DCAT (Data Catalog Vocabulary), Government, Higher Education/Research, Internal data hub, Open Data, Steven De Costa, Thought Leadership **Tags:** CKAN, DOI --- ### [How CKAN supports community-based water monitoring in Canada’s Columbia Basin Watershed](https://linkdigital.com.au/news/2025/09/how-ckan-supports-community-based-water-monitoring-in-canadas-columbia-basin-watershed/) **Published:** September 3, 2025 **Author:** Andrew Nette **Content:** Every data manager working behind the scenes on a data catalogue or open data portal faces a different set of complexities and challenges. - [About Living Lakes Canada’s GIS and Database Manager](#aioseo-about-living-lakes-canadas-gis-and-database-manager) - [Overview of hub’s challenges](#aioseo-overview-of-hubs-challenges) - [What is community-based water monitoring?](#aioseo-what-is-community-based-water-monitoring) - [The emergence of the Columbia Basin Water Hub](#aioseo-the-emergence-of-the-columbia-basin-water-hub) - [Balancing the data quality and participation](#aioseo-balancing-the-data-quality-and-participation) - [User control and data rights](#aioseo-user-control-and-data-rights) - [A look into the data submission process](#aioseo-a-look-into-the-data-submission-process) - [CKAN: helping power community based water monitoring](#aioseo-ckan-helping-power-community-based-water-monitoring) - [Measuring impact](#aioseo-measuring-impact) - [What advice does Finkle-Aucoin offer for these groups and anyone else who is potentially starting their journey in managing a data portal?](#aioseo-what-advice-does-finkle-aucoin-offer-for-these-groups-and-anyone-else-who-is-potentially-starting-their-journey-in-managing-a-data-portal) ## About Living Lakes Canada’s GIS and Database Manager One of these people is [Maggie Finkle-Aucoin](https://www.linkedin.com/in/maggie-finkle-aucoin-24b521157/), GIS and Database Manager at [Living Lakes Canada](https://livinglakescanada.ca/?), and manager of the [Columbia Water Basin Hub](https://data.cbwaterhub.ca/), a centralised on-line repository for water data collected from across the Basin. Built in partnership with [Link Digital](https://linkdigital.com.au/) and launched in early 2021, it relies on the efforts of a large network of stewardship groups that undertake community-based water monitoring, the results of which are uploaded – often directly by the groups themselves – into the Hub. For the past three years, Finkle-Aucoin has led the development and management of Hub, which helps communities across the Basin access and share information about their watersheds. She’s passionate about making water data more open, usable, and meaningful for the people who need it most. > We pride ourselves on being one on one with our contributors,’ says Finkle-Aucoin. We make sure that they feel comfortable, and that the data upload process is as easy as possible and as straightforward as possible, and CKAN \[[Comprehensive Knowledge Archive Network](https://ckan.org/)\] has been really lovely to help us do that, because the back end is so intuitive for users. You don’t need to be a programmer to get your data into the Hub, which is nice. ## Overview of hub’s challenges But while the diversity of the Hub’s stakeholders is a great strength, it also presents challenges. These include ensuring data quality and standardisation, as well as dealing with a plethora of community-based groups with very different levels of data skills. The following article will look at what the Hub does and the role CKAN plays within it, the value of community-based water monitoring, and how Hub staff like Finkle Aucoin balance community participation with running a technologically and socially sophisticated open data portal. ## What is community-based water monitoring? Living Lakes is a non-government organisation with 20 plus years’ experience working with community groups to protect freshwater within the Columbia Basin, North America’s fourth largest freshwater basin. It particularly focuses on elevating water science and stewardship through community-based water monitoring. Community-based water monitoring refers to local communities actively collecting data on water quality or quantity. Living Lakes currently works with more than fifty groups, primarily community-based water monitoring organizations, but also including commercial interests, Indigenous groups, local conservation organizations, and river users such as fishers, hunters, and kayakers. Between them, these groups have contributed most of the 500 or so datasets currently hosted by the Hub. ![Columbia Basin Water Hub - Living Lakes Canada](https://linkdigital.com.au/wp-content/uploads/2023/12/Image-SS-Columbia-Basin-Water-Hub-2-1024x536.png)[**Read case study:Columbia Basin Water Hub**](https://linkdigital.com.au/case-studies/columbia-basin-water-hub/) In addition to filling gaps in water data collected by larger government bodies, Finkle-Aucoin maintains community-based water monitoring > strengthens water stewardship and empowers people who are involved in these types of initiatives to protect their fresh water sources and take back a little bit of power. This is achieved by connecting them to water planning and decision making and stewardship and research. While local water monitoring had been going for many years prior to the Hub’s establishment, there were serious issues with how this data was being collected and stored. These became apparent during a series of meetings organised by Living Lakes in 2017, which brought together hydrologists from across British Columbia, to try and answer the question: was there enough data to understand the Columbia Basin’s health. The resounding answer from the meetings was no. While a multitude of local community groups were conducting water monitoring, they lacked streamlined archival and retrieval technologies for the data they collected. ## The emergence of the Columbia Basin Water Hub > Another thing that came out of this was, where is this data going? Where is there a log of what is happening and who is monitoring it? So, that is where the Columbia Water Basin Hub was born, this idea that there needed to be a centralised repository for water data in the Columbia Basin, specifically. Because we knew monitoring was happening but there was no way to track down that data and what it was. It was mostly being held on private devices, in some cases, even paper, and it was at risk of being lost. ## Balancing the data quality and participation The Hub was designed not only to store past, current and future water data, but to ensure adequate quality control and make the data more accessible and shareable. While having a network of community-based water monitors is an incredible asset, it is not without challenges for those working behind the scenes on the Hub. Not only are the groups doing water monitoring very diverse, so is the data they generate. This includes data on water quality, sustainable land use, changing weather conditions, ground water levels and reservoir modelling. The data is collected in different formats, making standardisation a challenge. ## User control and data rights Giving users the functionality to be able to directly upload their data was intentionally built into Hub’s design. All contributors sign a data sharing agreement outlining their rights and responsibilities, including the fact that even if it is hosted on the Hub, they are still the owner of the data and maintain full control of it, so they are also able to take down their data whenever they want. But while stakeholders can upload their data directly to the Hub, the various groups concerned have different data skill levels, which means not all of them are capable or want to do this. > The idea was initially that the Hub can be like a self-sustained data portal. So, we would make sure that users were able to contribute data and there wouldn’t be the need for someone like me to manage the portal. We laugh a little bit about this now because, even when users are able to upload their own data to the Hub, there is a need for that oversight and management over the portal. ## A look into the data submission process Data standardisation is obviously vital to making sure the data the Hub was ingesting is usable and machine readable. Apart from data skills, many of the groups doing water monitoring don’t have a lot of capacity and are already working on tight budgets, so to ask them to also take on tasks associated with data management can be a stretch. To get around this, Living Lakes helps community water monitoring groups to develop data management plans. And, if groups want to directly upload their data, Living Lakes also provides templates and will do a training session to provide them with the necessary skills to do so. > Or you can send us the data and we would manage the upload,” states Finkle-Aucoin. “Our team offers, basically, on a scale of zero involvement to a hundred. We have some contributors who, every month, \[just\] send us a raw data file straight from their logs and that is it. The Living Lakes team behind the Hub go through all the data uploaded by users, including undertaking a rudimentary quality assurance and quality control on it. > Perhaps there might be metadata info missing, or we might need some site photos. Or can you provide us with a little information about the calibration of equipment? And one of the best things that we’ve seen about the Hub is that data across the Basin has improved. It’s been one of the hidden unanticipated benefits of the Hub, that the quality of the water data has gone up. ## CKAN: helping power community based water monitoring In addition to being open source, which was highly desirable, CKAN was chosen as the software backbone of the Hub because the British Columbia and national government run their databases primarily on CKAN platforms. > Database integration has been important for us from the beginning. So, we saw choosing CKAN as a strength for development down the road when we potentially hope to get some better integration set up between those databases and ourselves. CKAN also helps Living Lakes support community-based water monitoring in other ways, including enabling the development of a standardised vocabulary which helps when people are uploading data and searching for it on the Hub. Finkle-Aucoin cites climate change as an example. > If someone is selecting a tag that says climate change, we want to make sure that the data it is generating is actually climate change data. And this is a good one for an example, because typically, everyone feels that all their data relates to climate change \[because\] it’s water. It’s the one they click every single time. > CKAN has \[also\] been really great because we’ve been able to get some tools in place that alert us whenever new data is uploaded so we can kick off our process of going through and making sure that things are kind of tackled as soon as possible. Lastly, Living Lakes has been impressed with the intuitive, user-friend set up of CKAN. This makes the portal relatively easy to use for those with varying levels of technical expertise. > The way that we are able to standardise the metadata is a definite strength and the way that this has made it \[the data\] accessible to users. You don’t have to be a programming whiz to get data up there. We are also able to set the parameters of the metadata, really let users know what information we’re looking for, what we need from them to accompany their data and they’re able to input that in there and we can force their hand a little bit to make sure that they are selecting the right options. *Also read:* [*How CKAN and FAIR Principles can enhance metadata management*](https://linkdigital.com.au/news/2024/08/how-ckan-and-fair-principles-can-enhance-metadata-management/) ## Measuring impact One of the most difficult jobs facing data managers is trying to measure the impact of their data catalogue or portal, and the Columbia Water Basin Hub is no exception. > Yes, measuring the impact is always one of the constant struggles. Obviously, it is our hope that people will reach out to us whenever they use our data but it’s not always the case, > > said Finkle-Aucoin. To get around this, Living Lakes undertakes outreach so that people know the site is there and what is on it, and to ask stakeholders, if they are using the data, how. > So much of our data, I think the largest portion of our data, is tabular data, which means very little to most folks. And our decision makers are not data analysts by any means. So, what we have done is we have set up meetings with different kinds of government officials. We try and make sure that as many people as possible know about the resources. We talk to the officials; we talk to their staff as well. ![Screenshot of map search within the Columbia Basin Water Hub](https://linkdigital.com.au/wp-content/uploads/2025/09/image-1024x669.png)*Screenshot of Map Search within the Columbia Basin Water Hub* Data from the Hub has been integrated into numerous reports and the government has also used the data in areas such as licensing the use of certain water bodies and groundwater analysis. The Hub’s data is fully integrated with the [Canadian Watershed Information Network](https://canwin-datahub.ad.umanitoba.ca/), a spatial research data infrastructure system hosted at the University of Manitoba, and also registered with [DataCite Canada](https://www.crkn-rcdr.ca/en/datacite-canada-consortium), which means it has a Digital Object Identifier, which has been useful in terms of seeing where it is being cited. According to Finkle-Aucoin, Living Lakes is also using the Hub’s data to create knowledge products through a Watershed Bulletin. > This is a project where we have taken our monitoring data and have transformed it using the idea of storytelling. So, for example, we’ve done one on groundwater data, one on hydrometric data, using the data that’s in the Hub, and creating stories around that data. This has been a really good way to get a new diverse audience’s eyes on the data that’s already been interpreted for them. **Conclusion** Future plans at the Hub include talking to groups and coalitions in watershed areas outside the Columbia Basin, about setting up their own data portals. > We actually have data from outside the Basin on our Hub because there isn’t an appropriate home for it elsewhere. So, we’ve been chatting with other watershed groups and coalitions of communities that might find benefit in having something similar to the Columbia Basin Water Hub and helping to facilitate those types of builds. ## What advice does Finkle-Aucoin offer for these groups and anyone else who is potentially starting their journey in managing a data portal? > I think the one piece of advice that I would give is, find your niche. For example, with the Columbia Basin Water Hub, we knew there was a gap that we needed to fill, we understood what that gap was well. We understood what our users needed well, from the process of engaging with them and talking with them, knowing where their struggles are. But even more so, always keeping that listening ear open. We are constantly accepting feedback, and we’re always ready to adjust and change for our user groups… Because without our users and without our contributors, we wouldn’t have much to show. [You can read a detailed case study of Link Digital’s work on the Columbia Water Basin Hub on our site here.](https://linkdigital.com.au/case-studies/canadian-watershed-information-network-canwin/) You can also read: - [Enhancing data visualisation: implementing a customised graphing extension for the Columbia Water Basin Hub](https://linkdigital.com.au/news/2024/10/enhancing-data-visualisation-implementing-a-customised-graphing-extension-for-the-columbia-basin-water-hub/) - [Why are open data portals crucial for building climate resilience?](https://linkdigital.com.au/news/2024/12/why-are-open-data-portals-crucial-for-building-climate-resilience/) **Categories:** All articles, CKAN, Environmental/Climate Change, Environmental/Climate Change, Geospatial, Industry, Non-profit/NGO, Open Data, Technology Infrastructure, Topics **Tags:** CKAN, open data --- ### [How to install CKAN using Docker Containers](https://linkdigital.com.au/news/2024/04/how-to-install-ckan-using-docker-containers/) **Published:** April 22, 2025 **Author:** Brett Jones **Content:** It seems that more and more these days CKAN running as containers is the preferred method for Production and Development CKAN environments. Having *one container* per service is the architecture that seems to cover most application needs. Its simplicity and ability to take advantage of quickly upgrading to new CKAN releases, however small, is a huge drawcard. In addition to its convenience and flexibility, deploying CKAN as Docker containers offers numerous benefits for both production and development environments. With each service encapsulated within its own container, the architecture ensures better isolation, potential scalability, and easier management of dependencies. Furthermore, Docker’s inherent portability facilitates smooth deployment across various environments, enabling developers to replicate configurations effortlessly and streamline the deployment process. This approach not only simplifies the deployment of CKAN instances but also enhances the overall agility and robustness of the ecosystem, empowering organisations to adapt swiftly to evolving requirements and leverage the latest CKAN features with minimal effort. In theory, as a developer, you could implement local modifications to a deployable CKAN image when your development environment’s architecture differs from that of the testing and production environments ## **CKAN as Docker Compose Services** The CKAN software stack is currently made up of 6 Docker Compose Services 1. NGINX 2. CKAN 3. Database 4. Solr 5. Redis 6. DataPusher These services each run in their own Docker container and thus can be upgraded or changed in some way separately from one another ![Docker Infrastructure](https://linkdigital.com.au/wp-content/uploads/2024/04/Docker-infrastructure-1024x739.jpeg "Docker Infrastructure")Docker Infrastructure In the diagram, the Docker Host can be of any computer architecture. I personally use Mac OS for day-to-day work and Ubuntu 22.04 virtual machines for testing. ## **Installation** I’m assuming you already have the Docker Engine software installed on your host machine. If not, you can use the information in this guide: to get it installed. The first thing that needs to be done is downloading the CKAN Docker repository (ckan-docker) **git clone** [**https://github.com/ckan/ckan-docker**](https://github.com/ckan/ckan-docker) This will create a ckan-docker directory. Within this directory you will need to do the following: - **cp .env.example .env** (create an environment file) The .env file is where specific changes can be made to environment variables e.g. a database connection string - **docker compose build** For each service defined in the Compose file (**docker-compose.yml**) this command will build the local image if the service definition includes the **“build”** command. Some services will just run a container directly from a remote image i.e.: an image from a docker repository (eg: DockerHub) Docker builds the Docker image in layers, based on the instructions in the Dockerfile. Each instruction in the Dockerfile (e.g., **RUN, COPY, ADD**) creates a new layer in the image. Docker caches intermediate layers to improve build performance, so if a Dockerfile hasn’t changed since the last build, Docker can reuse previously built layers, saving time and resources. Docker executes each instruction in the Dockerfile sequentially, performing tasks such as installing dependencies, copying files into the image, setting environment variables, and configuring the container environment. Once the build process completes successfully, Docker assigns a tag to the newly created image based on the service name and any specified tags in the Compose file. - **docker compose up** This command will run containers off those images. Each service will then have an associated container running. The services can also have relationships between each other. These links will be established during this command too. The Compose file (**docker-compose.yml**) file also defines the networks, container dependencies, healthchecks and the volumes used for CKAN and the other containers. While the services are starting, Docker Compose streams the output (logs) of each service to the terminal. You can see the logs of individual services and monitor their initialization process. Once all services have been successfully started, Docker Compose keeps them running in the background, allowing them to serve requests or perform their designated tasks. If any service encounters an error during startup, an error message is displayed, and stop is made to the affected service. This installation can take a while (5-10 minutes) if none of the local images exist before starting. Subsequent re-builds or stopping/starting containers can take advantage of the caching in Docker installs, and the time to get the whole CKAN system running can be dramatically reduced The end result is 6 containers running: ![How to install CKAN using Docker Containers](https://linkdigital.com.au/wp-content/uploads/2025/04/img-how-to-docker.webp) ## **Development Mode** There are 2 types of environments or modes – *base* mode and *development* mode. If you are a developer, you may want to install CKAN in Development mode. This mode makes it easier to get started for the development of new CKAN extensions and to make updates to CKAN core code. It uses the base mode CKAN image as the foundation and adds additional layers that a typical developer would require i.e.: instals development dependency libraries, creates a CKAN extension location (directory) on the filesystem. There are separate Docker Compose and Dockerfiles for Development mode. For instance, you would run the following command to build a Development environment: - **docker compose -f docker-compose.dev.yml build** And the following command to start the containers: - **docker compose -f docker-compose.dev.yml up** [ebook\_How to install CKAN using Docker Containers](https://linkdigital.com.au/wp-content/uploads/2025/04/ebook_How-to-install-CKAN-using-Docker-Containers.pdf)[Download](https://linkdigital.com.au/wp-content/uploads/2025/04/ebook_How-to-install-CKAN-using-Docker-Containers.pdf) ## **Customising (extending) your local image** To perform extra initialization steps, you can add scripts to customise your local images and subsequent containers. Copy these scripts to the **/docker-entrypoint.d** folder (The folder should be created for you when you build the image). Any **\*.sh** and **\*.py** file in that folder will be executed just after the main initialization script (**prerun.py**) is executed and just before the web server and supervisor processes are started. The sequence in which the scripts execute follows a lexical order. ## **NGINX** The foundational Docker Compose configuration employs a NGINX image (container) as the front-end, serving as a reverse proxy. HTTPS functionality operates on port 8443 within this setup. This of course can be changed to suit business requirements. As part of the ENTRYPOINT process, a self-signed SSL certificate is generated. Both the NGINX **server\_name** directive and the Common Name (CN) field in the SSL certificate have been uniformly set to ‘**localhost**‘. It is imperative to underscore that such a configuration is unsuitable for production environments. The Development mode configuration does not contain an NGINX service. The entrypoint into CKAN is the actual CKAN container itself ## **Relationship between the ckan-docker and ckan-docker-base GitHub repositories** The relationship between the **ckan-docker** GitHub repository and the **ckan-docker-base** repository is that the latter serves as the foundation for the former. Essentially, ckan-docker-base contains the essential configurations, dependencies, and infrastructure required to build base Docker images for CKAN. These base images provide a standardised starting point for deploying CKAN instances within Docker containers. The ckan-docker repository then builds upon this base by incorporating additional configurations, customizations, and services tailored for specific CKAN deployment scenarios. In summary, ckan-docker-base establishes the fundamental building blocks, while ckan-docker extends and customises these to create fully functional CKAN Docker environments. You can override the main configuration files (**Dockerfile, prerun.py** and **start\_ckan.sh**) from ckan-docker-base within the downloaded i.e. *cloned* ckan-docker directory structure. There is no need to create your own (local) modified ckan-docker-base base image ## **Related video: CKAN 2.10 install with Docker on Ubuntu 22.04** [This video](https://www.youtube.com/watch?v=nLGOiU3xVys&list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx&index=9) shows you how to install CKAN 2.10 from package. This is the quickest and easiest way to install CKAN, but it requires Ubuntu 20.04 or 22.04 64-bit. If you’re not using any of these Ubuntu versions, or if you’re installing CKAN for development, you should watch [Installing CKAN from source instead](https://www.youtube.com/watch?v=_JmwlDmST58&list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx&index=9&t=736s&pp=gAQBiAQB). If you would like to learn more about CKAN and how you can establish developer operations to support your data portal projects please [get in touch](https://linkdigital.com.au/get-in-touch/). --- **About [Brett Jones](https://www.linkedin.com/in/brett-jones-49369b8/)** *With a 30-year tenure in the tech industry, Brett Jones brings a wealth of experience across the globe. His career has traversed six international cities: Wellington, Sydney, Melbourne, New York, San Francisco, and Berlin, with an additional stop in Dhahran, Saudi Arabia. Throughout his journey, he has donned various hats at three tech giants – BEA Systems, Sun Microsystems, and Hewlett Packard. His expertise spans across diverse roles, including developer, solution architect/design, systems engineering, DevOps, and integration.* *Highlights of Brett’s impressive career include working on the trading floor at 60 Wall Street during the dot-com boom, experiencing the heart of Silicon Valley, and dedicating the last five years to the New Payments Platform (NPP) project in Sydney. His recent focus areas have been build automation, bespoke tool creation, application performance monitoring, and data engineering and analysis.* **Categories:** CKAN, Government, Higher Education/Research, Open Data, Tutorial **Tags:** CKAN Docker --- ### [Link Digital's series of CKAN video tutorials](https://linkdigital.com.au/news/2024/01/link-digital-releases-first-of-ongoing-series-of-ckan-instruction-tutorials/) **Published:** September 5, 2025 **Author:** Andrew Nette **Content:** One of the key open source technological solutions used by [Link Digital](https://linkdigital.com.au/) to build data management systems is the [Comprehensive Knowledge Archive Network (](https://ckan.org/)CKAN). This is what we refer to as out-of-the-box software. That is, it can work immediately when the product is placed in service. In CKAN’s case, once it is deployed and hosted on a web server. But CKAN also comes with a wealth of extensions and plugins that can increase its functionality. As a [CKAN ‘co-steward’](https://linkdigital.com.au/news/2019/08/co-stewarding-of-the-ckan-project-is-about-delivering-results-rewards-and-recognition/ "CKAN ‘co-steward’") and one of its largest contributing developers, [Link Digital](https://linkdigital.com.au/) is keen to support the large and diverse community of CKAN’s users and contributors. We are thus making available the first of twenty CKAN-related video tutorials by one of our global team of CKAN experts, Sergey Motornyuk. The first of these videos, uploaded to [Link Digital’s YouTube channel](https://www.youtube.com/@link-digital), contains an introduction to [Python](https://www.python.org/), a free, widely used open-source programming language that has an associated software implementation. Python is relatively easy to use and considered one of the most accessible programming languages. In the context of open data work, Python can help create tools and scripts for automating the publication and sharing of open data. Other uses include data retrieval and web scraping, the cleaning and preprocessing of raw data, and allowing users to analyse and visualise open data in an interactive and shareable format. The introduction comes in two parts. [The first tutorial video](https://www.youtube.com/watch?v=gBHbw8llRZ4) examines Python and its various components, the principles of object-oriented programming, introduces the fundamental data types, and the significance of variables in data storage and data manipulation. [The second tutorial video](https://www.youtube.com/watch?v=COq9qRbZhso) provides a deeper dive into Python. The videos are in Russian language but non-Russian speakers are able to listen to them by [utilising the Chrome Browser plugin called Language Reactor, available here](https://chrome.google.com/webstore/detail/language-reactor/hoombieeljmmljlkjmnheibnpciblicm). - Click on the ‘Add to Chrome’ button, - Then click on the ‘Add Extension’ button in the pop-up window. The plugin will then be added to the Chrome browser extensions and made available (and running) when viewing Sergey’s videos on YouTube. Other languages, apart from English, are also available. Further videos, which [Link Digital](https://linkdigital.com.au/) will be making available on YouTube over the coming two months, deal with other aspects of CKAN development, including HTML, Flask JavaScript, SQLAlchemy, Solr, CKAN installation, custom data fields, and CKAN API. The videos represent one of the most comprehensive and detailed collections of CKAN instructional videos available on the Internet. They complement the [CKAN installation and walk-through videos already posted on our YouTube channel by another one of our CKAN experts, Brett Jones.](https://www.youtube.com/playlist?list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx) If you have found this post useful, you might be interested in taking part in a series of forums being held by [Link Digital](https://linkdigital.com.au/) on the last Thursday of every month, Australian EDT. These forums will connect you with like-minded experts who are passionate about the importance of open data and want to stay updated on the latest developments in the field. They are free to attend and open to everyone. [Register today](https://linkdigital.com.au/public-forum/?utm_source=google&utm_medium=blog&utm_campaign=public+forum). **Categories:** All articles, CKAN, Environmental/Climate Change, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data, Resources, Technology Infrastructure, Topics, Tutorial **Tags:** CKAN --- ### [Village Building launch their latest development with Link Digital](https://linkdigital.com.au/news/2012/05/village-building-launch-their-latest-development-with-link-digital/) **Published:** May 4, 2012 **Author:** Steven De Costa **Content:** he new site developed for Village Building takes best advantage of our bespoke software development capability. We have integrated the [LinkCMS](/news/category/services/online/linkcms) with their Masterkey property development platform to provide a fully connected experience for website visitors. ![](https://linkdigital.com.au/wp-content/uploads/2017/08/Village_Building1-3.png)The LinkCMS provides Village Building with a wide variety of management options. ![](https://linkdigital.com.au/wp-content/uploads/2017/08/Village_Building_CMS-3.png)The top level of admin functions includes: - Manage Structure - Manage Articles - Manage Sidebar Articles - Manage Splash Images - Manage Mastheads - Manage Social Media - Manage Developments - Manage Packages - Manage Village Forum - Manage Forum Categories - Manage Village Blog - Manage Blog Categories - Manage Latest News - Manage News Categories - Registered Interest - Lifestyle Checklist - Manage Members - Manage Secure Resources - Meet Crackers - Manage Jobs - Manage Email Addresses - Manage Admins **Categories:** Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** Canberra database integration, Canberra web design, Canberra web development, Thought Leadership, Village Building --- ### [Yes, we support Government hackers](https://linkdigital.com.au/news/2012/05/yes-we-support-government-hackers/) **Published:** May 10, 2012 **Author:** Steven De Costa **Content:** GovHack 2012 took on some of the big issues facing government departments. Including, how does government engage with society to co-create a better future? With a strong focus on government data, GovHack invited teams of programmers and designers to invent new and better ways of delivering government data to Australians. Teams with the best apps, data ‘mashups’, and data visualizations competed to win a share of some $40,000 in prize money. As an in-kind sponsor, Link Digital provided a range of support to event organisers within the Australian Gov2au community. Most notable was the development of a website which supported the registration of ‘hackers’, the organising of ‘teams’ and the establishment of ‘projects’. The site became integral to running the event over the June 1-3 weekend in 2012. Link branded the community functionality within the site as the ‘Link Lab’. Over the Saturday and Sunday, while teams developed, the physical Link Lab was manned by staff from Link Digital on-site at the [University of Canberra InSPIRE Centre](http://www.canberra.edu.au/bettercampus/inspire). Our staff provided expert support to the competing teams during the hack, mostly around the setup of their project pages on the www.govhack.org website ![](https://linkdigital.com.au/wp-content/uploads/2017/08/composite-540x597-3.jpg)We were also happy to release our most recent addition to the Link team, Martin Ollman, on attendees during the Saturday workshop sessions. Martin is an expert on the installation, configuration and development of large scale Drupal platforms for Federal Government projects. ![](https://linkdigital.com.au/wp-content/uploads/2017/08/LINKLAB-4-3.jpg) **Categories:** Government, Open Data, Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** Government web designe, Thought Leadership --- ### [What does a digital agency know about women’s health, fitness and lifestyles?](https://linkdigital.com.au/news/2012/02/what-does-a-digital-agency-know-about-womens-health-fitness-and-lifestyles/) **Published:** February 27, 2012 **Author:** Steven De Costa **Content:** At Link the answer is “more than you’d expect”. This year we are major sponsors of the Sport for Women Day which showcases a series of sports and games to try out, demonstrations, celebrity appearances, kids activities and more. This event takes place on Sunday 4 March at 11am on the lawns beside Questacon. Some of the Link staff will be there so come along and join us for this energised event! [>> www.sportforwomen.com.au/sport-for-women-day/](http://www.sportforwomen.com.au/sport-for-women-day/) ![](https://linkdigital.com.au/wp-content/uploads/2017/08/SHYDRA_news-image4.jpg) **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Is there a new vision for CKAN? CKAN as a co-constructor for data, justice and truth](https://linkdigital.com.au/news/2025/07/is-there-a-new-vision-for-ckan-ckan-as-a-co-constructor-for-data-justice-and-truth/) **Published:** July 28, 2025 **Author:** Andrew Nette **Excerpt:** the portals that we are building, they are not just data repositories. **Content:** ![CKAN as co-constructor for data and truth](https://linkdigital.com.au/wp-content/uploads/2025/07/Image-CKAN-co-constructor-1024x576.webp) We are at the point of impact, according to [Steven De Costa](https://www.linkedin.com/in/stevendecosta/), Co-steward of CKAN and [Chairman of Link Digital](https://linkdigital.com.au/), in that the data portals we’ve built are not just repositories but potential launchpads for our shared, open, and civic futures. What potentially flows out of this situation was the subject of De Costa’s presentation at the latest CKAN Monthly meeting, in mid-July. CKAN – [the Comprehensive Knowledge Archive Network](https://ckan.org/) – is a sophisticated piece of open source software launched in 2006 that can be configured and set up to function as an open data platform once it is deployed and hosted on a web server. CKAN has established a significant social and technological footprint as the key component of some of the largest and most successful open data portals around the world. It is also the centre of a global network of data practitioners. But, according to De Costa, both the software and the community around it can be much more. ## CKAN as a sleeping giant Referring to it as “a sleeping giant,” De Costa posits that CKAN and its global community can do more to meet the key challenges we currently face: the need for a truly Responsible AI, the rise of digital authoritarianism, and the difficulty of building a greater shared understanding of social justice. Indeed, he believes CKAN can be a co-constructor for justice, agency, and truth and, in this way, a key player in developments such as shaping responsible and equitable AI futures from within the age of open data. > The data is not just data, he told the forum. > The software is not just software. There’s always perspective, there’s always context. In this respect, he maintains > the portals that we are building, they are not just data repositories. > They are also the people around them and the way that they can act as launch pads for better civic technology and public and civic outcomes. A key example offered by De Costa is how the community approaches responsible AI and the use of data in it. It can act defensively in response to this challenge, walling off open data from irresponsible AI appropriation. But it can also be proactive, using CKAN to help create positive datasets that will be good for machine learning and create positive outcomes for society because they have been cleared for responsible AI outcomes. ## Using constructor theory to rethink data De Costa referred to constructor theory as one framework that might be helpful in terms of helping the CKAN community rethink the role of data in shaping what societies believe is possible. Constructor theory expresses physical laws in terms of which physical transformations or tasks may be possible or impossible, and why. The core concepts are - Constructor: An agent or system capable of causing a transformation (e.g., a funding body, a policy). - Substrate: The entity being transformed (e.g., a dataset, a community, a project), but also an underlying substance or surface or material on or from which something grows or changes. - Task: The transformation itself. A record of what is possible versus impossible. In this model, CKAN and the open data ecosystem are a kind of substrate. Looking at CKAN as a constructor helps us move from an understanding of what data is to what data does. > It is useful for a data-oriented community that is thinking about how data connects with things like AI, and what might be necessary political and technical procedures and tasks and models related to this. De Costa used a case study to try to illustrate his arguments, a project he was putting together for the [Global Data Barometer Visualisation Challenge](https://globaldatabarometer.org/2025/06/global-data-barometer-data-visualization-challenge-2025/). The Challenge invites users to put together creative ways of exploring the Barometer’s data to help tell powerful stories about data for the public good. And he explained how his project was aimed not just at visualising the data contained [in the latest iteration of the Open Data Barometer](https://opendatabarometer.org/?_year=2017&indicator=ODB), but visualising the process of the data’s creation and the physics of its constructors. This included tracing the flow of influence, funding, and ideology through the data ecosystem. Taking it back to CKAN, De Costa maintains: > It is not just about cataloguing data it is about understanding the full substrate of value creation that a tool like CKAN can create in that substrate. ## A call to build There was a lot more in De Costa’s presentation, which can be watched in full [here](https://www.youtube.com/watch?v=sf4vArZrBBU). But arguing it is vital for us to move from being passive data publishers to active co-constructors of our future, he ended his presentation with a call to action or, as he put it “a call to build”. He invited people working in open data to become what he called “Odious Xers”—pioneers who collaboratively shape the future through agile, impactful “block builds”. [They can do this by joining the group he has set up](https://groups.google.com/a/linkdigital.com.au/g/odiousx?pli=1), which aims to bring people together in two-hour sessions twice a week, every Friday and Sunday morning, Australian EST time The idea is to try and start to generate > a coalition of intent to build civic tech and build towards social outcomes… that is driven by the agency of individuals, rather than being driven by funders or technology or in reaction to politics. And in doing so, it presents an opportunity to unite efforts under a shared purpose – to use the unique position of the community around CKAN to build a more equitable world, one dataset, one transformation, one “block build” at a time. --- ## **Are you keen to take the user experience of your open data portal to the next level?** [Contact us](https://linkdigital.com.au/get-in-touch) and one of our experts will be in touch. - [Facebook](https://www.facebook.com/LinkDigital) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/) **More articles** - [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) - [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) - [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) - [When the visitors aren’t human: What rising bot traffic means for your data portal](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) - [From open data to verifiable honesty: An experiment you can look at](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) **Categories:** All articles, CKAN, Open Data, Steven De Costa, Thought Leadership **Tags:** CKAN, Constructor Theory, Open Data Barometer, Steven De Costa --- ### [Why user experience is an essential component of your open data portal](https://linkdigital.com.au/news/2025/07/why-user-experience-is-an-essential-component-of-your-open-data-portal/) **Published:** July 11, 2025 **Author:** Andrew Nette **Excerpt:** Poor user experience (UX) can seriously hold the discoverability, usability and reusability of the data on your portal. Let's look at the key elements of good UX design and why it's so important. **Content:** ***This post was co-authored by [Anastasiia Shevtsova, UI/UX Designer at Link Digital](https://www.linkedin.com/in/anastasiia-shevtsova-853b15158/)*** - [What is user experience?](#aioseo-what-is-user-experience) - [Balancing the competing needs of your data portal audiences](#aioseo-balancing-the-competing-needs-of-your-data-portal-audiences) - [Link Digital's approach to UX design](#aioseo-link-digitals-approach-to-ux-design) - [Pain points and automate tasks](#aioseo-pain-points-and-automate-tasks) - [User testing](#aioseo-user-testing) - [Important UX features in the design of an open data portal](#aioseo-important-ux-features-in-the-design-of-an-open-data-portal) - [Search and discovery](#aioseo-search-and-discovery) - [Dataset exploration](#aioseo-dataset-exploration) - [The download process](#aioseo-the-download-process) - [Data publishing](#aioseo-data-publishing) - [Collaboration](#aioseo-collaboration) - [Advanced features](#aioseo-advanced-features) - [Data visualization](#aioseo-data-visualization) Not surprisingly, perhaps, the focus for those building open data portals is often the hard tech and data-related aspects of the job; ensuring the datasets and metadata are high quality, that the site is interoperable, and that the other technological aspects are running smoothly – the nuts and bolts of effective data sharing. But there is another vital aspect of the design and construction of open data portals that is often overlooked: the user experience (UX). Even if your data is of the highest quality, poor UX can seriously hold back the discoverability, usability and reusability of the datasets on your portal. In short, you ignore it at your peril, regardless of the tech stack you are using. Let’s look at the elements that make up good UX design and why it’s so important. ![User experience for your open data portal is essential](https://linkdigital.com.au/wp-content/uploads/2025/07/Image-UX-developers-final-1024x535.webp)User experience for your open data portal is essential ## What is user experience? The main purpose of UX informed design is building products that help people to complete their tasks easily and without frustration and unnecessary pain points. In the case of an open data portal, this is obviously helping people find, understand, download and use the data. Taking UX design into consideration when building an open data portal entails the entire process, including design, useability and function. Peter Morville, the founder of what is known as [information architecture](https://en.wikipedia.org/wiki/Information_architecture), proposed a UX Honeycomb consisting of seven principles for effective UX design: usefulness, desirability, accessibility, credibility, findability, usability and value, and impact. This encompasses posing questions during the design phase, such as: does the product solve the problem it was designed to address (usefulness); is it easy to navigate (usability); is it simple to navigate (findability); and does the design makes its accessible, regardless of factors such as physical status, age, gender and cultural background, etc (accessibility). ## Balancing the competing needs of your data portal audiences We have previously discussed the challenges of building open data platforms and associated data products that can speak to everyone. This can be a particular challenge when the proposed portal’s design parameters are set and monitored by people without design experience, or when the portal is being established in a bureaucratic or political context. For example, for a government client which may be keen to share data with the public but sees them as a passive consumer, rather than an essential stakeholder in the development process. As Maeva Tesan, from the [Pacific Data Hub](https://pacificdata.org/) and [Pacific Community Centre for Ocean Science](https://www.spc.int/pccos), [noted in a recent interview on our site](https://linkdigital.com.au/news/2025/05/the-challenges-of-building-websites-that-can-speak-to-everyone/), too often the design of open data portals is “shaped \[only\] by the mindset of project managers, usually leaning toward the project management perspective,” especially when these portals deal with scientific data. This means that the tools and language can feel too complex for people without data experience. Complexity is not only often necessary for many users in government or research circles, it is also their second nature. They require advanced features and functionality like advanced filtering, accessing APIs, geospatial tools, automating Digital Object Identifier registration, and the ability to handle very large datasets. The solution is often to try and find a balance catering to the experts and catering to the wider public. One example,cited by Tesan, is the [Climate Change Flagship](https://climatechangeflagship.spc.int/), a site affiliated to the Pacific Data Hub. The design, done with Link Digital, provides technical information on complex topics like mitigation and adaptation, while making the site easily navigable and understood. Clear labelling and naming conventions are important, as is presenting data visually. The Flagship site provides [an interactive map](https://climatechangeflagship.spc.int/pacific-climate-change-projects-map) that enables the user to quickly get country-specific data on all climate-related projects underway across the Pacific. ## Link Digital’s approach to UX design Link Digital has nearly two decades of experience building world-class open data portals for clients, including government, not for profits, and universities. This includes extensive expertise in UX design. The first step is to understand the target audience and what they might be trying to achieve by visiting the portal. We usually start by defining the most frequent user tasks, whether it is searching and downloading a dataset or viewing a dashboard. This helps shape the structure and priorities of the design. Then we look at what might prevent users from achieving their goals or block them from completing certain tasks. Key to this is investigating user behaviour. If they are available, we will analyse current portal interfaces, talk to stakeholders, and review analytics data to see where users drop off or get stuck. If a lot of the users of the site land on a dataset page without downloading anything, for example, we need to ask why. Perhaps there is a problem, or the file format isn’t what they expected. ### *Pain points and automate tasks* We also try to reduce pain points and automate tasks such as showing previews of data, clearly labelling restricted datasets, or helping users understand when data was last updated. The goal is to balance the complexity that is often necessary in a high functioning data portal, and advanced features to those who need them, while trying to make the interface as clear and logical as possible, so that non-experts can learn to use it faster. Perhaps the content can be organised in a way that matches how users might think, which might be different to how the system is built. We can also add hints, onboarding tutorials, and help sections to guide new users. After that, we can start working on the structure and layout, i.e., organising content clearly so users can move through the portal naturally. This involves the creation of wireframes or clickable prototypes to test and refine ideas early. ### *User testing* Finally, while they are not always seen as part of the design process, our experience is that user testing sessions of interactive prototypes are essential to improve on the design phase. These can show us how real people interact with the interface, if something is confusing, too complicated or hard to find. Based on the feedback from these we can refine the design to make the user journey smoother and more intuitive. We also think about the mobile experience. More people access portals on phones or tablets, so it’s important the interface works well on smaller screens, with clean layouts, readable text. ## **Important UX features in the design of an open data portal** When designing an open data portal, it is important to focus on the major aspects of the user journey – the typical paths people take on a portal. ### *Search and discovery* Search and discovery is one of the most important of these. Many users come to the portal looking for something specific, so a strong search experience is vital. Smart filtering and sorting options, and things like advanced search functionality, autocomplete, or suggestions to guide users are important. Word embeddings can also help users find relevant data, even if they use different terms. In short, we try to make the interface helpful, intuitive, and engaging, so users can not only complete their tasks, but also discover new possibilities on the portal they didn’t know about. Important design features to help with this might might include: ### *Dataset exploration* Once users locate a dataset, they should be able to quickly understand what it contains. That means clean metadata layout, data previews, file formats, license info, and visual summaries like charts or maps when possible. ### *The download process* This should be clear, fast, and flexible. That means showing the available file formats and offering different options, i.e., downloading the one file or just a filtered view. If the file is large, users appreciate seeing the file size or an estimated download time. It is also important to show a confirmation message or progress indicator, so users know the download has started successfully. ### *Data publishing* For contributors, uploading data should be clear and needs little guidance. This can be made easier with step-by-step forms, tooltips, and validation messages that explain what’s missing or incorrect. ### *Collaboration* Can users discuss datasets, give feedback, sharing, suggest corrections, rate quality, or ask for additional data? Some portals allow users or groups to create shared pages or dashboards. Supporting this journey means adding features like comments, version history, user roles, or notifications. These tools help build trust and turn the portal into a more active, connected space. ### *Advanced features* A big part of the UX experience is revealing advanced features that users often don’t know exist. For example, how to help users trace a topic they are interested in and get notifications when new data is published, allow them to create dashboards and visualisations, explore data and compare results using different map layers, and publish large amounts of data with advanced tools. ### *Data visualization* A customisable chart or datasets presented on a map can help users explore, compare data, export or share results. This way, users don’t just find raw datasets, they can also explore themed dashboards in real time, get insights, and better understand the data. [This is something we have looked at in more detail in other posts on our site](https://linkdigital.com.au/news/2025/05/how-to-tell-stories-with-data-using-these-ckan-extensions-and-other-tools/). ## **Are you keen to take the user experience of your open data portal to the next level?** [Contact us](https://linkdigital.com.au/get-in-touch) and one of our experts will be in touch. - [Facebook](https://www.facebook.com/LinkDigital) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/) **More articles** - [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) - [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) - [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) - [When the visitors aren’t human: What rising bot traffic means for your data portal](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) - [From open data to verifiable honesty: An experiment you can look at](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data, Topics **Tags:** data portal, open data, open data portals, user experience, UX design --- ### [How to tell stories with data using these CKAN extensions and other tools](https://linkdigital.com.au/news/2025/05/how-to-tell-stories-with-data-using-these-ckan-extensions-and-other-tools/) **Published:** May 27, 2025 **Author:** Andrew Nette **Content:** *This blog post was co-authored by Adrià Mercader and Sergey Motornyk, Senior Solutions Architects at Link Digital* - [Interviews with the experts](#aioseo-introduction) - [CKAN: a powerful storytelling engine](#aioseo-ckan-a-powerful-storytelling-engine) - [CKAN extensions for geospatial data](#aioseo-ckan-extensions-for-geospatial-data) - [Extensions to create interactive data experiences](#aioseo-extensions-to-create-interactive-data-experiences) - [Dashboards: another level of interactivity with data](#aioseo-dashboards-another-level-of-interactivity-with-data) ## Interviews with the experts An open data portal powered by [CKAN – the Comprehensive Knowledge Archive Network ](http://ckan.org)– can streamline and improve your data collection and publishing and empower users by producing better quality data and more trustworthy analysis. But a key challenge facing many data managers is how to more effectively move data off their portal and into the hands of those who can use it, especially non-expert audiences. A recent series of interviews with data managers featured on Link Digital’s site highlighted one way of making a portal’s data more accessible: creating visually engaging stories and other accessible knowledge products. For [Claire Herbert, Head of Digital Strategy](https://www.linkedin.com/in/claire-herbert-mb/?originalSubdomain=ca "Claire Herbert, Head of Digital Strategy") at the [Canadian Watershed Information Network](https://canwin-datahub.ad.umanitoba.ca/) (CanWIN), a vital task is trying to get out facts about freshwater science in a way that is understandable to the public and tells a story about a relevant topic. In 2020, Link Digital updated the CanWIN site to help researchers better tackle the complexity of the data on freshwater they were collecting. According to Herbert, the next stage in the portal’s evolution is getting the data out to the local communities CanWIN works with, which involves simplifying access and making it more understandable and accessible for non-expert audiences. A similar sentiment was expressed by [Malcolm Fraser, Programme Manager ](https://www.linkedin.com/in/malcolmfraser/?originalSubdomain=nz "Malcolm Fraser, Programme Manager ")of the [Pacific Data Hub](https://pacificdata.org/ "Pacific Data Hub"), an open data portal that serves as a gateway to the most comprehensive data collection relevant to the 22 Pacific Island nations. > Data has no value sitting on a hard drive. It has plenty of value when it is being moved around and helping to do things like informing decision-making. So, it is all about empowering people to get their hands on it. But how can you make more engaging stories out of the datasets on your portal? ![Pacific Data Hub](https://linkdigital.com.au/wp-content/uploads/2025/05/img-PDH-mockups-1024x763.webp)*Case study: [Pacific Data Hub ](https://linkdigital.com.au/project/pacific-data-hub/)* ## **CKAN: a powerful storytelling engine** The basic functionality of CKAN is your starting point. Because you need to understand the data you have, ensure its quality and make it discoverable as the first step to presenting it in a more engaging way. CKAN gives you the ability to store, catalogue and share data externally. CKAN’s powerful metadata capabilities not only allow users to host and share the data that they collect, but to standardise it into common language terms that everyone can understand. Let’s take the CKAN-powered CanWIN open data portal, managed by the [University of Manitoba’s Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/) (CEOS), as an example. A leading multidisciplinary and collaborative research centre focused on understanding how the earth will respond to climate change, CEOS conducts fieldwork globally, with the Arctic freshwater marine system a particular focus. The ability to develop consistent, standardised metadata schemas enables CEOS researchers to understand the type of data they are collecting and how it was collected, including what instruments were used to collect it. They were also able to create a common data dictionary that researchers working across the globe can use when comparing and discussing data. In other words, they have a common language to understand the data, before they ever collected their first data point, which is vital to re-using the data and turning it into research and other data products. But CKAN is also highly customisable [through a wide variety of extensions](https://extensions.ckan.org/) that vastly increase the software’s out-of-the-box functionality and seamlessly integrate it with a user’s existing data and digital operations. This includes extensions to help you to make compelling stories out of the data within a CKAN portal, by combining visualizations with explanatory text and interactive elements. These can bring high value data sets to life and make viewing them a less static and more narratively engaging experience, whether you are talking about climate change, freshwater conservation, international development, education, or whatever. ## **CKAN extensions for geospatial data** From a technical point of view, extensions are the Python programming language packages that one installs in a CKAN site. Each extension provides one or more plugins that extend or modify CKAN’s basic default behaviour. There are numerous CKAN extensions related to the visual presentation and exploration of geospatial data, i.e., displaying the data or the spatial extent of the data on a map. One of these, [*ckanext-geoview*](https://github.com/ckan/ckanext-geoview), contains plugins that helps improve the accessibility and understandability of geospatial datasets in CKAN portals, improving a portal’s geospatial search and metadata harvesting functions, and the ability to render and visualise common geospatial data formats including [GeoJSON](https://geojson.org/), [ArcGIS Rest](https://developers.arcgis.com/rest/), API endpoints, and [Web Map Service](https://www.ogc.org/standard/wms/) in various map form for users. Another key extension, [*ckanext-spatial*](https://github.com/ckan/ckanext-spatial), helps CKAN understand a location associated with a dataset, for instance, a pair of coordinates, a bounding box for the dataset extent, or an arbitrary polygon. These geometries are then indexed, allowing users to perform spatial searches for datasets that fall within an area of interest. This extension also includes harvesters that allow for the importation of common geospatial metadata formats, making them discoverable as CKAN datasets. Together, [*ckanext-geoview*](https://github.com/ckan/ckanext-geoview) and [*ckanext-spatial*](https://github.com/ckan/ckanext-spatial) are the most used extensions in Link Digital’s geospatial data related toolbox. Both are easy to install and designed to integrate seamlessly with the user’s existing data tooling. ## **Extensions to create interactive data experiences** Another useful extension to improve data visualisation within a CKAN powered portal is [*ckanext-charts*](https://github.com/DataShades/ckanext-charts). This was initially developed by Link Digital [during our work on an internal data portal for the international medical NGO, Médecins Sans Frontières/Doctors Without Borders](https://linkdigital.com.au/project/medecins-sans-frontieres-data-sharing-platform/). MSF were keen to get a better sense of how many datasets they had and in what stages of processing they were in at any given time. The extension enables data managers to create more dynamic visualisations to enhance data interaction and presentation by creating, editing, embedding and sharing interactive charts directly from tabular datasets stored in CKAN. You can select the best chart type that fits your data – line, bar, scatter, pie charts, etc – and enables their presentation in customisable colours. It allows users to better visualise time series, categorical, or proportional data. In MSF’s case, the extension helped achieve greater workflow visualisation – the various stages of verification and approval that datasets went through before being uploaded to its internal data portal. The [*ckanext-blocksmith*](https://github.com/DataShades/ckanext-blocksmith "ckanext-blocksmith") is a powerful page-building extension for CKAN, developed by [Cherniavskyi Oleksandr](https://www.linkedin.com/in/oleksandr-c-a0a63318a/ "Cherniavskyi Oleksandr") at Link Digital. Built entirely on the [GrapesJS](https://github.com/GrapesJS/grapesjs "GrapesJS") – a free and open source web building framework – it brings drag-and-drop visual editing capabilities directly into the CKAN ecosystem. With it, users can design rich, custom pages composed of modular content blocks, without writing code. Each block can include elements like text, images, embedded videos, HTML components, forms, sliders, or previews generated by other CKAN extensions such as *ckanext-geoview* or *ckanext-spatial*. *Ckanext-blocksmith* combines flexibility with ease of use, enabling non-developers to create visually engaging, data-driven pages that better communicate the value and context of published datasets. Currently in the final stages of development and testing, *ckanext-blocksmith* will empower users to build richer, data-driven pages—without needing developer assistance. ## **Dashboards: another level of interactivity with data** But even with their added functionality, the extensions mentioned so far can only visualise data uploaded into CKAN. For those wanting to visualise datasets external to CKAN, a popular solution is dashboards. Dashboards can display datasets dynamically, helping to organise visualisations and narrative elements for storytelling, and they are easy to add to an existing site without having to create any new interface. ![](https://linkdigital.com.au/wp-content/uploads/2025/05/Pacific-Data-Hub-Maritime-Boundaries-dashboard-scaled-1024x567.png)Pacific Data Hub Maritime Boundaries dashboard One example of an effective dashboard is the [Maritime Boundaries site](https://pacificdata.org/dashboard/maritime-boundaries), hosted by the Pacific Data Hub. Built by Link Digital, the dashboard is designed to share relevant information on Pacific Island maritime boundaries and zones, based on information held by the United Nations with support from the Pacific Maritime Boundaries Consortium of Partners and through the [Pacific Maritime Boundaries Program](https://gem.spc.int/projects/pacific-maritime-boundaries-programme). It enables users to click on a particular boundary and view information and datasets associated with the country or territory concerned. The dashboard also contains information about how maritime boundaries are formed. There are a range of dashboard tools that can be easily integrated with CKAN to deliver a more visual, interactive experience. One of the most popular is [Microsoft Power BI](https://www.microsoft.com/en-us/power-platform/products/power-bi). Using built-in open source visuals, the platform enables users to create their own visualisation experiences out of different sources of raw data, including those stored in CKAN. Power BI can be integrated easily into CKAN using the extension [*ckanext-power-bi*](https://github.com/open-data/ckanext-power-bi). A completely open source application that has a similar functionality is [Leaflet](https://leafletjs.com/), an easy to use JavaScript library for building interactive maps. Link Digital used Leaflet to build the [Maritime Boundaries site](https://pacificdata.org/dashboard/maritime-boundaries) mentioned above. --- If you want to know more about how different data managers are rising to the challenge of making their data more accessible, you can read my interview with CanWIN’s Claire Herbert, [here](https://linkdigital.com.au/news/2025/04/from-collecting-data-to-telling-stories-a-cost-effective-journey-in-freshwater-data-management/). My interview with Malcolm Fraser, Programme Manager of the Pacific Data Hub, [is available here](https://linkdigital.com.au/news/2025/05/more-than-just-a-data-hub-an-interview-with-malcolm-fraser-programme-manager-pacific-data-hub/). **Let’s work on your data project** Are you interested in crafting more visually engaging stories using the data from your portal? [Reach out today.](https://linkdigital.com.au/get-in-touch/) **Categories:** All articles, Amazon Web Services (AWS), CKAN, Drupal, Environmental/Climate Change, Geospatial, Higher Education/Research, Open Data **Tags:** CKAN extension --- ### [Developer talks about updates on CKAN functionalities and its future](https://linkdigital.com.au/news/2025/07/developer-talks-about-updates-on-ckan-functionalities-and-its-future/) **Published:** July 1, 2025 **Author:** Kate Sampher **Content:** ## Summary In the [final episode of Link Digital’s Tuesday Talks](https://www.youtube.com/watch?v=DRo5oPQdb28), Sergey Motornyuk, a core developer of CKAN (Comprehensive Knowledge Archive Network), discusses the latest developments and future plans aimed at improving the software’s user experience, developer convenience, and system performance. He talks about the involvement of two of Link Digital’s Senior Solutions Architects, [Ian Ward](https://www.linkedin.com/in/ianward/) and [Adrià Mercader.](https://www.linkedin.com/in/adriamercader/) The key developments include: Ian’s work on the new Table Designer feature to enable users to push partial updates for some of the large datasets rather than reloading the entire file, which reduces page latency. Adrià’s enhancements to search functionality through semantic search and a common search interface for multiple search engines and Sergey’s own work on a file management system. This new system treats files as first-class entities with version control, flexible storage options, resumable uploads, and better access control, promising significant benefits for developers, maintainers, and end-users. He also mentioned the efforts to enable dynamic metadata validation for easier extension integration and a modern, highly customizable UI framework that moves beyond the current Bootstrap dependency. Overall, the focus is on increasing CKAN’s flexibility, extensibility, and usability for a broad spectrum of users and developers, ensuring backward compatibility while pushing innovation. ![CKAN functionalities update from Link Digital, the CKAN experts.](https://linkdigital.com.au/wp-content/uploads/2025/07/Image-CKAN-Functionalities-Update-1024x535.webp)*[CKAN Functionalities Update as shown on Link Digital’s Tuesday Talks episode 7](https://www.youtube.com/watch?v=DRo5oPQdb28&t=250s)* ## Timestamp and Key Insights ### **Performance Optimization with Partial Page Updates** [03:39](https://youtu.be/DRo5oPQdb28?t=224) – By integrating HTMX for dynamic content refreshing, CKAN drastically reduces page reload times during search filtering, providing a smoother and faster user experience critical for large-scale portals. This approach minimizes unnecessary data transfer and rendering, a best practice for web applications dealing with large datasets. ![Partial page updates on CKAN - Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/07/img-updating_parts_page-955x1024.webp) ### **Semantic Search Using Machine Learning** [06:55](https://youtu.be/DRo5oPQdb28?t=415) – Incorporating word embeddings transforms traditional keyword-based search into a context-aware system, allowing users to find relevant data even when search queries use synonyms or related terms. This enhances discoverability and aligns with modern AI-driven search trends. ### **New file management flow and resumable uploads** [14:21](https://youtu.be/DRo5oPQdb28?t=688) – Treating files as first-class entities with metadata and version history enables better tracking, audit trails, and sharing flexibility. Support for resumable uploads and multi-cloud storage addresses real-world challenges like unstable connections and heterogeneous infrastructure, key for scalability and enterprise adoption. ![CKAN file management then and now - Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/07/Image-file-management_before_after-1024x535.webp)CKAN’s File Management (Then and Now) ### **File metadata, versioning, and access control** [16:19](https://youtu.be/DRo5oPQdb28?t=979) – Automating schema updates when enabling/disabling extensions reduces human error and maintenance overhead. This modular approach fosters a more sustainable ecosystem where plugins can evolve independently without breaking compatibility. ### **Benefits of new file system for users and developers** [21:18](https://youtu.be/DRo5oPQdb28?t=1278) – Sergey’s work is focused on developer-centric improvements. This is to streamline interfaces for integrating new storage backends and file handling logic, cut down customization complexity and technical debt, and encourage contributions and wider ecosystem growth. For portal maintainers, they will benefit from flexibility in storage and file management, while for end users there’s convenience in the following features: - Drag & drop uploads. - Resumable uploads (pause/resume on network failure). - Parallel uploads from multiple sources for faster large file uploads. - Incremental uploads (upload only changed parts of a file). - Automatic metadata extraction from files to create datasets/resources. ### **Dynamic data validation and metadata schemas** [26:41](https://youtu.be/DRo5oPQdb28?t=1601) – Discussing metadata schemas, Sergey highlights the challenges developers face when enabling extensions that require schema changes. He is currently developing dynamic schema validation, which enables extensions to dynamically register fields. This plug-and-play approach simplifies extension management, reduces manual schema updates, and could enable runtime extension toggling from the admin interface. ### **UI restyling and flexible design frameworks** [29:43](https://youtu.be/DRo5oPQdb28?t=1783) – The current CKAN UI is being restyled to look modern and support easier customization. Sergey envisions a two-layer abstraction allowing portals to switch design frameworks (e.g., Bootstrap, Tailwind) while preserving custom styles and structures. This flexibility will enable organizations to tailor CKAN’s appearance and layout extensively, breaking free from Bootstrap constraints and improving adoption. ## **The Community and Openness as Core Values** Sergey mentions CKAN’s commitment to open source principles, welcoming contributions and ideas from users, which fuels continuous improvement and ensures the software remains relevant across various industries. Throughout the discussion, Sergey emphasizes CKAN’s core philosophy of openness – both in terms of the code and open community contributions. This episode of Tuesday Talks shows [Link Digital’s continuous investment and direct involvement in the community](https://github.com/DataShades/), making CKAN an ideal choice for organizations seeking a flexible, extensible, and powerful data management platform. **[Watch the full recording](): Developer Talks about CKAN Functionalities and Its Future** [](https://www.youtube.com/@link-digital) --- **Want to build a CKAN-powered open data portal or internal data catalogue?** [Contact us](https://linkdigital.com.au/get-in-touch) and one of our experts will be in touch. - [Facebook](https://www.facebook.com/LinkDigital) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/) Read more articles - [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) - [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) - [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) - [When the visitors aren’t human: What rising bot traffic means for your data portal](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) - [From open data to verifiable honesty: An experiment you can look at](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) **Categories:** All articles, CKAN, Environmental/Climate Change, Government, Higher Education/Research, Industry, Kate Sampher, Non-profit/NGO, Resources, Topics --- ### [Why are open data portals crucial for building climate resilience?](https://linkdigital.com.au/news/2024/12/why-are-open-data-portals-crucial-for-building-climate-resilience/) **Published:** July 23, 2025 **Author:** Andrew Nette **Excerpt:** How open data portals can provide data to help build climate resilience. Read the article to learn more. **Content:** Let’s examine how open data portals can help government, business, and civil society by providing data for better informed decision-making and action around climate mitigation and resilience. - [Climate data: a complex, growing ecosystem](#aioseo-climate-data-a-complex-growing-ecosystem) - [What role can open data portals play?](#aioseo-what-role-can-open-data-portals-play) - [Improved data discoverability](#aioseo-improved-data-discoverability) - [Improved data quality](#aioseo-improved-data-quality) - [Increased Collaboration](#aioseo-increased-collaboration) - [Building climate resilience: open data portals in action](#aioseo-building-climate-resilience-open-data-portals-in-action) - [The Canadian Watershed Information Network](#aioseo-the-canadian-watershed-information-network) - [The Columbia Basin Water Hub](#aioseo-the-columbia-basin-water-hub) - [Pacific Data Hub](#aioseo-pacific-data-hub) - [Sharing and Enabling Environmental Data (SEED) portal](#aioseo-sharing-and-enabling-environmental-data-seed-portal) - [FAQs](#aioseo-faqs) - [How can organizations interested in building their own open data portal get started?](#aioseo-how-can-organizations-interested-in-building-their-own-open-data-portal-get-started) - [What are some practical examples of open data portals that support climate resilience?](#aioseo-what-are-some-practical-examples-of-open-data-portals-that-support-climate-resilience) - [What is the significance of open data portals in the context of climate data?](#aioseo-what-is-the-significance-of-open-data-portals-in-the-context-of-climate-data) ## **Climate data: a complex, growing ecosystem** Open data is information collected, produced, and paid for by public bodies and made available to be used, re-used, and shared in readable formats. In much the same way that the COVID-19 pandemic turbocharged the increasing use of open data in scientific research and government decision-making, the climate crisis is driving a growing demand for quality open climate data from a wide spectrum of stakeholders. These include governments seeking to make better policy, civil society groups wanting to take meaningful climate action of their own and hold polluters to account for what they do or do not do, and financial institutions and regulators wanting to conduct better climate risk assessments and improve reporting and disclosure. As the [United Nations Environment Programme](https://www.unep.org/topics/climate-action?gad_source=1&gclid=Cj0KCQiAvP-6BhDyARIsAJ3uv7ZntUmoP0tAMCAT2CiJ6LGjtajezwzazM_aSQGdd0cwdKrgbD9Njt0aAhNLEALw_wcB "United Nations Environment Programme") notes: Beyond understanding the actual impacts of climate change on different aspects, which include the social and economic implications that have already been realised, it is crucial to have climate data of sufficient availability, quality, timeliness, and comparability. These data enable the evaluation of climate risks and opportunities as well as their potential impacts. Climate data are therefore indispensable for the development of effective strategies and policies for climate mitigation and adaptation.[\[1\]](#_ftn1) But the climate data ecosystem is complex. For example, while many national governments report emissions data under the [United Nations Framework Convention on Climate Change](https://unfccc.int/resource/docs/convkp/conveng.pdf), not all the data is open or easily accessible, especially by those who do not attend global or regional climate change talks. In addition to emissions data, climate data collected and reported on by governments includes agricultural productivity and food security, human and ecosystem health, flood risk, renewable energy and carbon offset information, etc. This data is gathered from numerous sources, including citizen-generated data, universities and research institutions, and the private sector. And like all data, climate data can be of variable quality, and there can be gaps in its reliability, comparability, and timeliness. It is often presented and stored in different formats, fragmented across agencies, geographic and legal jurisdictions, and not made interoperable formats. And, even when it is easily accessible, it can be very complex and difficult to understand and analyse. [![CKAN 2.11 migration by Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/10/final-CKAN-2.11-migration-1024x535.jpg)](https://linkdigital.com.au/news/2024/10/ckan-2-11-migration-what-you-need-to-know/)[Migrating to CKAN? Here’s what you need to know](https://linkdigital.com.au/news/2024/10/ckan-2-11-migration-what-you-need-to-know/) ## **What role can open data portals play?** Open data portals can make climate data more easily shareable and encourage impactful reuse. This fosters transparency and collaboration, as well as facilitating faster evidence-based action to build climate resilience. They can do so in several ways. ### ***Improved data discoverability*** Open data portals support users to search for and discover data assets based on various criteria, such as keywords and tags, across different platforms and domains. This makes it easier to find and reuse the datasets they need for their work. It empowers applications and those who use them to register, update, and refine datasets, improving data quality and ensuring that any research or analysis that uses the data is trustworthy and accurate. By centralising and organising the collection and dissemination of climate data from multiple sources, open data portals can act as a single point of truth for stakeholders seeking data to inform their research, policy development, or action. They can enable state and local governments to collect, manage, and publish localised climate data, which is essential for developing more targeted solutions. They also provide a wide range of tools to visualise and analyse the data through maps, charts, and dashboards, making it easier to comprehend. ### ***Improved data quality*** In addition to increasing access, open data portals can help standardise and improve the quality of climate data. Open data portals can implement measures to improve metadata quality to enhance the findability, accessibility, interoperability, and reusability of data. Portals encourage the use of common formats, services, and vocabularies, such as [Data Catalogue Vocabulary (DCAT)](https://linkdigital.com.au/news/2024/09/what-is-dcat-and-why-is-it-important-for-data-catalogs-and-open-data-portals/), which is designed to facilitate interoperability between data published on the web. Open data portals also provide tools to keep data up-to-date, accurate and mechanisms to incorporate user feedback systems, allowing users to report errors. ### ***Increased Collaboration*** In addition to acting as central aggregators to guide and improve data collection, open data portals enable more effective collaboration by empowering researchers working on similar projects or topics to connect and share resources. This can help harmonise the fragmented and often incompatible nature of existing climate data sources. The user management features of many open data portals enable the creation of collaborative spaces in which researchers and stakeholders from different institutions and across geographic jurisdictions can access and work together on shared datasets. It allows them as a group to contribute different data to a shared project – for example, combining government climate measurements with university research findings – refine datasets and metadata, and explore, independently corroborate, and build upon each other’s work. The ability to pool technical tools and expertise to avoid duplicating efforts results in more comprehensive, robust research outcomes. Some of the ways in which the features of open data portals can directly help to build climate mitigation include: - Improving climate modelling and predicting. This helps governments and communities take measures to adapt to rapidly changing climatic conditions. Some climate modelling is fed by open datasets and their results have begun to be published openly. - Enhancing food security and protecting livelihoods by allowing open data on global/national weather patterns, rainfall, temperatures, etc, to be combined with locally captured data, allow farmers to adapt their agricultural practices. - The analysis of data on extreme weather events makes it possible to design strategies to mitigate their impact or enable faster and more effective disaster responses. Open data portals can also function as a form of affordable digital infrastructure for lower-income countries that are often the most vulnerable to the impacts of climate change but lack the resources to set up the sophisticated technological systems required to collect, monitor, and interpret data related to it. [![Data visualisation and dashboard for Living Lakes Canada with Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/10/LLCA-blog-image-1024x535.jpg)](https://linkdigital.com.au/ckan-and-open-data/)[*Publish your data easily with CKAN*](https://linkdigital.com.au/ckan-and-open-data/) ## **Building climate resilience: open data portals in action** Link Digital is a global expert in the design and building of open data portals. Portals we have built to help organisations have real world impact in terms of climate resilience include: ### ***The Canadian Watershed Information Network*** Managed by [University of Manitoba’s Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/), the [Canadian Watershed Information Network](https://canwin-datahub.ad.umanitoba.ca/) collects and manages a large array of climate data, including spatial data, analyses and shares it with researchers. In 2020, Link Digital overhauled an existing platform to allow for greater data storage capability and enable researchers to tell more complex stories about the data in their work. The job involved installing new visualisation tools, customising metadata templates to improve search efficiency, and adding user permissions to provide data sovereignty to Indigenous groups to give them granular control over their data. The changes enable researchers across institutions to collaborate on climate data analysis and share findings for analysis from a hyperlocal to global scale. [*Read more about Link Digital’s work on the Canadian Watershed Information Network*.](https://linkdigital.com.au/project/canadian-watershed-information-network-canwin/) ### ***The Columbia Basin Water Hub*** The[ Columbia Basin Water Hub](https://data.cbwaterhub.ca/) is the open data portal developed by [Living Lakes Canada](https://livinglakescanada.ca/) for freshwater data within the Columbia Basin, in response to the need for a more coordinated water monitoring effort in the region. Their science-based programs are aligned with Canadian Provincial and Federal monitoring protocols and range from groundwater, lake, stream, and wetland monitoring to foreshore health assessments, biomonitoring for aquatic assessment and restoration, and water database development and management, and include analysing data on the impact of climate change. [*Read more about Link Digital’s work on the Columbia Basin Water Hub.*](https://linkdigital.com.au/project/columbia-basin-water-hub/) ### ***Pacific Data Hub*** Overseen by the [Pacific Community (SPC)](https://www.spc.int/), the principal scientific and technical organisation for the Pacific, the [Pacific Data Hub](https://pacificdata.org/) was launched in late 2020 and serves as a gateway to the most comprehensive data collection of relevance to the 22 Pacific Island nations and territories. Designed to tackle the fact that Pacific related data and statistics are hard to locate, fragmented, incomplete and held in multiple geographic locations and by various stakeholders. the Hub provides a reliable, easily accessible, up to date source of quality data on a range of issues, including climate change. This includes the first detailed estimates of the [coastal proximity of populations in 22 pacific island countries and territories](https://pacificdata.org/story/coastal-proximity-populations-22-pacific-island-countries-and-territories). The data, a collaborative project between SPC, University of Wollongong and the not for profit research organisation [WorldFish](https://worldfishcenter.org/about-us), is vital data in terms of assessing vulnerability to natural disasters, economic and livelihood issues, and mitigating the impacts of climate change. [*Read more about Link Digital’s work on the Pacific Data Hub here*](https://linkdigital.com.au/project/pacific-data-hub/)*.* ### ***Sharing and Enabling Environmental Data (SEED) portal*** The [SEED portal](https://www.seed.nsw.gov.au/) was launched by the New South Wales Government in 2016 to provide a centralised place where the community, industry, consultants, NGO’s, researchers and government can come to search for, access, contribute and share NSW environmental data. As part of changes to make the SEED portal more interactive, Link Digital upgraded the site and turned into a multi-hub service with several integrated themed hub environments, such as water, natural hazards and the Natural Capital Accounting, etc. These hubs provide a single point of truth for the dissemination of high quality, standardised environmental data, and enable organisations to engage with their stakeholders around data available on SEED, including on issues related to climate resilience. [*Read more about Link Digital’s work on the SEED portal here.*](https://linkdigital.com.au/project/sharing-and-enabling-environment-data-seed-portal/) ## **Want to build an open data portal?** Building your climate data portal shouldn’t be a hassle. [Contact us](https://linkdigital.com.au/get-in-touch/) and one of our data portal experts will be in touch. --- [\[1\]](#_ftnref1) United Nations Environment Programme (2024). *The Climate Data Challenge: The Critical Role of Open-Source and Neutral Data Platforms*, Geneva, 2. *This blog post was co-authored by [Alex Gostev](https://www.linkedin.com/in/alexgostev/), CKAN Contributor.* ## FAQs ### How can organizations interested in building their own open data portal get started? Organizations can contact data portal experts, such as those at Link Digital, to receive guidance and support in designing and implementing an effective climate data portal tailored to their needs. ### What are some practical examples of open data portals that support climate resilience? Examples include the Canadian Watershed Information Network, the Columbia Basin Water Hub, the Pacific Data Hub, and the Sharing and Enabling Environmental Data (SEED) portal, each providing vital data to support climate action and resilience efforts. ### What is the significance of open data portals in the context of climate data? Open data portals play a crucial role in making climate data more accessible, shareable, and reusable, which fosters transparency, collaboration, and accelerated evidence-based actions for climate resilience. **Categories:** All articles, CKAN, DCAT (Data Catalog Vocabulary), Environmental/Climate Change, Environmental/Climate Change, Government, Higher Education/Research, Open Data, Technology Infrastructure **Tags:** CKAN, climate change, climate data, climate resilience, open data portals --- ### [Brisbane City Council selects Link Digital to deploy and manage an improved open data platform.](https://linkdigital.com.au/news/2015/05/brisbane-city-council-selects-link-digital-to-deploy-and-manage-an-improved-open-data-platform/) **Published:** May 22, 2015 **Author:** Steven De Costa **Content:** The Lord Mayor’s strategy for a Digital Brisbane includes establishing an improved experience of the city through digital technology. The target for 2013-2018 is to provide world-class digital services that support residents, visitors and newcomers to Brisbane. Council has selected CKAN under a support arrangement with Link Digital to enable their world-class open data initiatives into the future. Brisbane City Council’s Open Data Project continues to build on Council’s commitment to transparency with the aim of providing even easier ways to find, access and reuse Council’s public datasets. Residents, visitors and the developer community are able access the data that Council holds, and to use that data however they see fit – free of charge. Open data facilitates the development of apps, websites and tools that both benefit Brisbane residents and help Council work towards its vision of Brisbane as an accessible, connected city. Brisbane City Council’s new world-class CKAN platform will be launched ahead of GovHack 2015, strongly supporting Brisbane’s involvement in GovHack while also demonstrating commitment to Council’s open data principles: - Council recognises that all data is PUBLIC and made available for release, unless otherwise restricted under legislation, including the Information Privacy Act 2009 (Qld). - Wherever possible, Council will provide information at no cost. - Council will share information with other government or open data agencies unless otherwise restricted under legislation. - Council commits to maintaining accurate and reliable data sets and repairing errors when identified. **Categories:** CKAN, Government, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [The Perfect Storm: Service Oriented Government, Data Classification and AWS](https://linkdigital.com.au/news/2015/05/the-perfect-storm-service-oriented-government-data-classification-and-aws/) **Published:** May 9, 2015 **Author:** Steven De Costa **Content:** Earlier this week I presented at the AWS symposium for public sector, education and non profits. The deck I used can be found below with the session title and advertised description. The general points I hoped to make when presenting were: 1. Link does AWS stuff and sells services etc… 2. Using Drupal, CKAN and AWS together is pretty neat and here are two examples on why that is 3. Slide 12 and 14 show the general approach used for the data first media platform we built for ACT Government and the setup we use for Victorian Government’s open data release model (three tiers of CKAN environments). 4. Data classification… the list on slide 16 shows the questions that need to be marked ‘no’ to release a dataset publicly on the Data.Vic platform. After those points I looped back to the economic points I would normally start with. So, covering the definition of economic goods, why information goods are MOAR good, going through the principles of open government, making a point about the basic role of Australian Government and finally talking about transaction costs. I think the transaction costs slide is the most important. When you recognise that collaboration provides not only a higher quality of innovation but also a lower cost, then you can then move on to suggest that every external contract from the public sector into the private is an example of a ‘private-public’ partnership. If this is recognized then we can start to ask whether the procurement and delivery mechanisms of Government are setup to respect the value derived from the ‘collaborative procurement’ and ‘collaborative management’ oe would expect to see in private-public relationships. **[The Perfect Storm: Service Oriented Government, Data Classification and AWS](//www.slideshare.net/starlen/the-perfect-storm-service-oriented-government-data-classification-and-aws "The Perfect Storm: Service Oriented Government, Data Classification and AWS")** from **[Steven De Costa](//www.slideshare.net/starlen)** Presented at the AWS Government, Education, and Nonprofits Symposium in Canberra, 6 May 2015. Summary: This session will demonstrate how to reduce costs while expanding your opportunities for innovation on Amazon Web Services. It will consider a practical approach for data classification and security controls over objects and API endpoints which span an agency, its jurisdiction and the public. It will cover the foundations of Open Government from it’s principles of transparency, participation and collaboration. It will touch on the economics of open data and the cost reducing effect of digital transactions being enabled right now throughout the public sector. Finally, we’ll look at real world examples from the Government Digital Service in the United Kingdom, the Victorian Government’s Information Asset Register and those expected from the Federal Government’s Digital Transformation Office. **Categories:** CKAN, Government, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Data First – A Practical Guide](https://linkdigital.com.au/news/2015/04/data-first-a-practical-guide/) **Published:** April 7, 2015 **Author:** Steven De Costa **Content:** ## About this guide To effectively structure and migrate the world’s expansive sources of knowledge into machine readable open data platforms of real value, we need both technical and non technical data boffins to work together. Vast linked data platforms which span aspects of every human endeavour are on our collective horizon. The Internet of Things, of People, and of Humanity. ## Let’s put data in its rightful place – First and Last Twenty years ago we’d dismiss indecipherable data with throw away lines like “You only get out what you put in”. We didn’t use thoughtful terms like ‘stewardship’ when we talked about data. We labelled it ‘maintenance’ which meant hiring a temp with no prior knowledge of your business, products, services or goals, to half-heartedly scan a bunch of almost integrated spreadsheets that reportedly housed the same data. They’d be given a five minute brief, mostly explaining where the kitchen was, and instructed to delete double-ups in the spread sheets and get rid of anything that looked, well, wrong. Data was little more than a largely annoying and convoluted reporting tool, tacked onto the end of Board Meetings when everyone was just waiting for their cab to the airport. The importance of data as an asset was not well understood. The repercussions of this attitude to data resonate today – because we didn’t think strategically in the collection, maintenance and integration of our data sets we ended up leaving this extraordinary asset not only in the hands of disengaged temps, but spread across fragmented and loosely coupled IT systems and a grubby patchwork of legacy software. Shame on us. And as if that’s not enough guilt to fuel the downward spiral of data neglect, now there’s the whole open data movement creeping into mandated ICT strategies that not only expect everyone to keep useful, quality data, but to share it, with the public, without restriction! ## The love of data Thankfully, the value and potential of data is achieving recognition as a strategic consideration. World-class organizations and governments alike are mining vast troves of data to obtain actionable intelligence, leading to deep customer/population insights, improved business processes, higher profits and/or savings where applicable, political gain and even transparency. More and more we are considering the governance, quality and full life cycle of our data: including how it will retain value for future use. In a growing number of scenarios the value of opening up and sharing data more broadly is also being recognised: not least of all, as a means of getting the most mileage, which of course ties in nicely to trends in developing new sources of data and new storage and retrieval platforms. ## Start with a tidy up Think: consolidation, metadata; and stewardship Once you understand the key strategic and operational questions you need your data to respond to, you can start the data cleanse, improvement and consolidation process. It’s easy enough to say that in one sentence but, yes, it does involve a lot of work at the get go (and a future blog piece). I’m not referring to the old process of hiring a temp. Your data is simply not worth holding onto if you don’t invest some resources up front in ensuring it is harmonised, integrated and defined by sound policy and architecture. Whether you bring in a consultant, seek out an all new consolidation platform or choose to go it alone, remember this is also the critical time to fix your metadata collection. Without the right metadata there’s simply no “Who, What, Where, When, and How” to describe your data. Such a lack of structure and meaning means no one can responsibly re-use or interpret the data and the whole exercise becomes invalid. Effective data stewardship is more than verifying quality, security and protection of your data, it’s also about letting your data thrive. Even if you don’t wish to open things up to all and sundry, you may still seek to allow a degree of broader access privileges, at least in regard to non-proprietary data. ## The pursuit of data Now you know that data has such far reaching value and potential it may be time to extend and enhance the type of data sets you hold and the means by which you capture it. Sourcing universally, or at least via a network of like-minded collaborators (and depending possibly too on where your data sits within the whole Open Data movement), is an investment in the ongoing relevance of data. It’s an easy equation: people filling a database with what matters to them = a database full of what matters to the people. Additionally, allowing for a mix of media – photos, video, audio and other formats – can augment your collection and influence longevity. ## Next, what should the solution look like? In summary, a nice platform for the storage, access and retrieval of all your consolidated and/or new data needs to enable the following: - Private and public user interface components as required - A web based data upload facility – could be universal or access controlled - A variety of media formats - Compelling, or at the very least interpretable, data visualisation - Intuitive and enduring search and browse functionality, faceted for narrowing a search - Engaging design - Agility, conducive to insights driven service delivery or information sharing - Sound and relevant collection of mandatory and automatic metadata - Readiness for integration with other applications - Multi-tenant users, potentially unlimited - Low cost media storage with a storage infrastructure component for transcoding large files and managing archiving of lesser used resources Effective data stewardship with a view to the full data life cycle suggests that, while you may not wish to have all the above functionality switched on at the start, it should be possible for the future. ## So if that’s all about putting data first, what do I mean by also putting it last? Forget “first things first”, the best data platforms start by considering the end – or at least the end user, and the worth of your data to the end user down the track. As futurist Ray Kurzweil once said “an invention has to make sense in the world in which it is finished not the world in which it is started”. So to, the data we collect and store today has to be useful for retrieval tomorrow, although it also has to make sense today so, um, let’s end things here and not dissect the Kurzweil reference too much. Except perhaps to just ask, is the end user a human or a machine? **Categories:** Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Open data - striking the balance, relieving the burden.](https://linkdigital.com.au/news/2015/05/open-data-striking-the-balance-relieving-the-burden/) **Published:** May 22, 2015 **Author:** Steven De Costa **Content:** The challenge for individual agencies to develop data access methods that strike the best balance between data confidentiality, protecting privacy, maintaining data quality and releasing data that’s interpretable, relevant and actually valuable to users, now and in the longer term: that’s a big ask without direction. Open data is at the core of an ideal data system where we’ll see the integrating of data from an array of sources—private, public and community, business and household; cross-sectional and longitudinal, survey and administrative, national and sub-national. We’re at the point now where all the leading pundits agree, this new approach to collecting and sharing data will permit business dynamics as well as G2C and C2G to be enhanced in myriad and even globalised ways, but committing the time and resources to conceptualising, let alone realising those opportunities, is assumed by many to be far too daunting a task. How do we leverage the potential of our data, for our benefit and for the good of all? Opening up data, it is feared, is nothing but a big drain followed by a flurry of downloads in the short term. Without the right holistic forecasting of its possibilities Agencies are handicapped by the one big fear that looms ever perilously. It’s the sinister mainstay of accountability: the fear of getting it wrong. There are three key ingredients to negating such fears. ## 1. High level policies and guidelines need to be created Analysts need to be engaged to help develop high level policies and guidelines. This could be Whole of Government or, where necessary jurisdictional but it’s important not to leave it in the hands of bureaucrats alone. You have to go big picture. You have to think beyond any immediate impact to service delivery. We hardly need to make the case anymore. There are a number of evidence based reports on the value of open data now published, not to mention high value data sets, data publishing best practice…. there are case studies galore, and advice across a number of lessons learnt. All of this provides enough evidence for analysts to now do direct work within industry segments and model the expected impact of shifting Government operations at a policy level. Open government and open data are being mandated to varying degrees across many jurisdictions but assistance with econometric modelling is crucial. Perhaps an Open data consultants Panel or at the very least a Multi Use List could provide a good starting point. ## 2. The public sector needs more digital leaders Enter, the Digital Transformation Office (DTO). The DTO will become an Executive Agency on 1 July 2015. I have high hopes for the DTO. Their agenda is all about streamlining service delivery, digitally, with a customer focus. Not specifically on enabling a shared data model, but, the whole thing is underpinned by a drive to empower citizens. In this regard streamlined digital services and open data are congruent pursuits. Also, the startup-esque nature of this new agency could herald the beginnings of a new style of end user focussed bureaucrat. It’s a gamble: introducing yet another office churning out rules is one thing; but stacking it with a new breed of digital bureaucrats, well that’s virtually unprecedented. But the public service is changing (identifying and meeting head on its own shortcomings in service delivery to this extent is testament to that). We also need to see more digital leaders being employed, trained-up and promoted within other agencies too. ## 3. Open collaboration for open data In the current long-term business environment, a highly effective APS institution is one which works effectively with other sectors and jurisdictions, including the private sector, not-for-profits, states and local government. In 2015 ‘collaboration” for government is no longer just another word for ‘paying lip service’. If you look at the leadership and core skills strategy refresh for 2014-2015 you’ll see that the APS has identified the need to be more effective via nurturing opportunities for collaboration. We are seeing this collaborative mindset come into it’s own already with encouragement from Minister Turnbull to build on Public-Private partnerships and the WoG emphasis we see in programs like data.gov.au and govCMS. The aforementioned DTO is set to further boost this collaboration ethos. Community and not for profit groups funded by sponsors from industry, research and academia and individuals with domain experience on open data, knowledge systems, community engagement and humanities are also well placed to partner with Government agencies at this time. Similarly as with Private partnerships such groups can save the Government money. One reason why budgets are lowered is simply that the cost of generating innovation within Government is higher than it is in the private sector. The cost of innovation within community groups supported by volunteerism is lower again. So now the opportunity exists to tick that collaboration box while also trimming back expenses via public-private partnerships with groups like Code for Australia, GovHack teams, Open Australia, ODI, OKAU and many others. Community and Private sector involvement across the whole process of releasing data enables that invaluable sense of ownership. When we own something, we want it to be right and we want to see it thrive. In some cases the government can spend millions to sustain a dataset which is 70% correct. Sharing it, even with that deficiency, empowers the community to fix the data itself. The Government role then shifts to becoming more of a subscriber and contributor rather than the sole owner. For open data this longevity is further promised via supporters continually seeking a range of improvements: the best platforms for sharing, the best Apps, the best forecasting. Ownership will keep the conversation alive. Next week I will be at the International Open Data Conference (IODC) in Ottawa to moderate a sharing session on data publishing methods. The IODC will be a unique opportunity to collaborate on creating a map of best practices within the area of data publishing. For details, you can review the session information on [www.opendatacon.org](http://sched.co/36rw). **Categories:** Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Link launches The South Australia Office for Digital Government website](https://linkdigital.com.au/news/2015/12/link-launches-the-south-australia-office-for-digital-government-website/) **Published:** December 5, 2015 **Author:** Steven De Costa **Content:** Link Digital along with the South Australian Government has recently launched The South Australia Office for Digital Government website at http://digital.sa.gov.au/. The website provides resources that support South Australian Government agencies to transform services to digital, including strategies and policies which deliver digital leadership and strengthen citizen services for all South Australians. The website is built in Drupal and runs on highly available auto scaling Amazon Web Services infrastructure. Most notably, the website makes use of taxonomies that provide the site structure and ensure that content editing tasks require little effort. Rather than having to create content and manually insert it, once content is entered it is given a classification and automatically gets published to the right section within the website. Link Digital took an agile approach to developing the website, ensuring there were several review points that gave the client the opportunity to review our progress and allowed them to change prioritisation of features yet to be built or swap out planned features with different ones. Throughout the duration of the project, small design and consulting tasks were also undertaken when required to help refine the scope of the project. Link Digital worked closely with the client all the way through the process to ensure each iteration was better than the last, creating value in the end product all the way up to the launch date. Link Digital is able to offer Australian Government entities CKAN, Drupal and AWS hosting, support and consulting services under procurement options within the Department of Finance Cloud Service Panel. **Categories:** Government, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Open Access, Research Management and Executable Papers.](https://linkdigital.com.au/news/2015/07/open-access-research-management-and-executable-papers/) **Published:** July 10, 2015 **Author:** Steven De Costa **Content:** ## Open Access Universities and research organisations across the world from [The Open University](http://www.open.ac.uk/) in the UK to [Landcare Research](http://www.landcareresearch.co.nz/) in New Zealand have launched [open access](https://en.wikipedia.org/wiki/Open_access) initiatives, moving beyond a centuries-old paper-based platform for sharing research. A great example is [NARCIS](http://www.narcis.nl/) in the Netherlands, founded in 2005 and now hosts over 1.1 million open access publications across nearly 3,000 member organisations. Australian tertiary institutions have also moved towards open access with the Australian Open Access Support Group (AOASG) whose membership includes the Australian National University, University of Western Australia and Macquarie University. There is also the [Research Data Australia](http://ands-uat.anu.edu.au/) repository, a collaboration between the [Australian National Data Service](http://www.ands.org.au/) and data providers including the University of Melbourne, Monash University, Geoscience Australia and CSIRO. Open Access encourages sharing and collaboration by making research easier to find, use and cite. It also reduces the reliance on collections of journal subscriptions and publications that can cost universities millions of dollars per year. ## Research Management Systems (RMS) Universities implement research management systems to assist with workflows and business intelligence surrounding the administration of research grant applications through to the publishing of papers and research artefacts. They have a number of options to consider but might select providers such as [ResearchMaster](http://www.researchmaster.com.au/) or [Symplectic](http://symplectic.co.uk/) who have developed specialised platforms for research management. Or, they might choose to extend existing workflow, record or document management systems to accomodate the use cases of research management. Utilising products like [HP Trim with the support of companies such as iCognition](http://www.icognition.com.au/products.html), or products like [Infiniti provided by Intelledox](http://www.intelledox.com/infiniti/). ## CKAN as a Platform for Open Access and Executable Papers Whatever the RMS solution an integrated open data publishing platform enables moderated and automatic publication of metadata about grants and research from the RMS workflow as well as the actual research outputs. A range of intellectual property licensing options can be provided to a university and its researchers to protect rights and control usage of data and research artefacts including Creative Commons (CC) and Open Data Commons Open Database License (ODbL). CKAN is an open data publishing platform developed and maintained by the software community worldwide under the same open source movement that inspired Open Access. As an open data management system CKAN being used by the [United States Government](http://www.data.gov/), [national](http://www.data.gov.au/), [state](https://www.data.vic.gov.au/) and [council](https://www.data.brisbane.qld.gov.au/) jurisdictions in Australia, the [UK Government](http://data.gov.uk/) and many cities and municipalities from [Ottowa](http://data.ottawa.ca/) to [Buenos Aires](http://data.buenosaires.gob.ar/) and [Taipei City](http://data.taipei/). Link Digital specialises in open data platforms and is heavily involved in the open knowledge community. One of the natural extensions for CKAN is its use for publishing a wide variety of research artefacts. This can include image and video assets via CKAN Galleries for research within the humanities or it can include a wide variety of specific data formats used by research teams. Link Digital has also recently developed a proof of concept to successfully delivered scalable, on-demand high performance computing environments which simulate super computer facilities used by research teams worldwide. This work allows the publishing of papers, data and the scripts to generate public cloud infrastructure required for rapid peer review of research by research labs at extremely low cost with very low technical barriers. ## Expanding Horizons for CKAN Link Digital manages and supports CKAN for the [Australian Federal Government](http://data.gov.au/), [South Australian Government](https://data.sa.gov.au/), [Victorian Government](https://www.data.vic.gov.au/), [NSW Government](http://data.nsw.gov.au/) and [Brisbane City Council](https://www.data.brisbane.qld.gov.au/). We have the expertise and experience in guiding organisations towards open data and implementing open data publishing platforms, particularly via CKAN. Through adoption of a data first and open access approach Link has identified opportunities to expand the use case of CKAN in the following areas: 1. Digital Asset Management – particularly via CKAN Galleries 2. Community and Government Service Management 3. Research Management 4. Record Management 5. Programme Management 6. Information Asset Management If you would like to learn more about how the open data management system CKAN might help your organisation to generate better value from its data then [please feel free to get in touch](https://linkdigital.com.au/get-in-touch/). **Categories:** Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Is there a model for Friction-less Science?](https://linkdigital.com.au/news/2015/12/is-there-a-model-for-friction-less-science/) **Published:** December 7, 2015 **Author:** Steven De Costa **Content:** *Note: This is a repost from discussion I started on the [Open Knowledge forum](https://discuss.okfn.org/t/is-there-a-model-for-frictionless-science/1203).* I’ve been doing work with open Government data for the last few years, mostly around the platform capability of CKAN. As I’ve gone further into the various areas concerning data I’ve necessarily bumped up against project requirements for hosting a platform for research data. While CKAN needs some maturity in this space it has some immediate application in the area of open access catalogues; to make available both research papers and research datasets. It is less mature in the area of research management systems or managing ‘working data’, but I don’t think it is too much of a stretch to integrate or develop with these extended requirements in mind. However, when looking at open access I’ve been considering what frictionless science might look like. I’ve been thinking about how to publish the full set of research artifacts needed to replicate and review work undertaken by labs, or to swap out data and reconstitute the research in a new context. That thinking, done only with little access to end users, has revealed the following short list of what might be published as a ‘dataset’ listing of ‘resources’. 1. Paper – the summary narrative which explains all context for the work 2. Data – any raw data used to test a hypothesis 3. Code – and algorithms or open source codebases and configurations details used to work with raw data to produce insights or secondary analysis inputs 4. Environment – any infrastructure orchestration scripts for automating the replication of data analysis in publicly available cloud environments. With that all said, I thought to draw those interested in this idea to the following recent work: Pyramids, pipelines and a can-of-sweave – work done by [Florian Mayer](https://twitter.com/fistful_of_bass) for the WA Dept of Parks of Wildlife. I think this is a great example of how to cover the first three points above. How to build a supercomputer on AWS with spot instances – work done by [Link Digital](https://linkdigital.com.au/) (disclosure – this is my company) as a funded proof of concept thanks to Intel, AWS and the NCI (24th largest supercomputer facility in the world as of this afternoon). You can review the work via the video demonstrations below. **Categories:** Amazon Web Services (AWS), Open Data, Steven De Costa, Thought Leadership **Tags:** CKAN, research data, Thought Leadership --- ### [Drupal, CKAN and Public Data](https://linkdigital.com.au/news/2016/03/drupal-ckan-and-public-data/) **Published:** March 21, 2016 **Author:** Steven De Costa **Content:** DrupalGov Canberra was held at the National Museum of Australia on February 8th 2016, bringing together the best Drupal talent in the country to address challenges specific to the public sector. I was there to deliver a session covering the opportunity surrounding Drupal and CKAN open data portals. There are a number of easy ways to integrate the two projects to improve data publishing, discoverability and visualisation. Thanks to the volunteers from Drupal ACT the session was recorded and can now be found online. You can watch the embedded version below, or view the [Drupal, CKAN and Public Data](https://www.youtube.com/watch?v=j-jofZONJuQ) session on DrupalGov’s YouTube Channel. You can also browse the [complete playlist of DrupalGov 2016 sessions](https://www.youtube.com/playlist?list=PL-cZvV8glkbA3OTs4Vygc2RrZd-pcici1). Link Digital provides both CKAN and Drupal development, hosting and support services for various clients around Australia and worldwide. We are active in the CKAN community and are long term supporters of both the Drupal Association and the CKAN Association. Some of the portals we currently manage include: [![](https://linkdigital.com.au/wp-content/uploads/2017/08/AU-2.png)](http://data.gov.au/)## [data.gov.au](http://data.gov.au/) [![](https://linkdigital.com.au/wp-content/uploads/2017/08/NSW-2.png)](http://data.nsw.gov.au/)## [data.nsw.gov.au](http://data.nsw.gov.au/) (CKAN and Drupal) [![](https://linkdigital.com.au/wp-content/uploads/2017/08/VIC-2.png)](http://www.data.vic.gov.au/)## [data.vic.gov.au](https://www.data.vic.gov.au/) (CKAN and Drupal) [![](https://linkdigital.com.au/wp-content/uploads/2017/08/SA-2.png)](http://data.sa.gov.au/)## [data.sa.gov.au](https://data.sa.gov.au/) (CKAN and Drupal) [![](https://linkdigital.com.au/wp-content/uploads/2017/08/WA-2.png)](http://data.wa.gov.au/)## [data.wa.gov.au](http://data.wa.gov.au/) [![](https://linkdigital.com.au/wp-content/uploads/2017/08/BCC-2.png)](http://data.brisbane.qld.gov.au/)## [data.brisbane.qld.gov.au](https://data.brisbane.qld.gov.au/) (CKAN and Drupal) We also manage a number of private Information Asset Registers based on CKAN for various Government agencies and jurisdictions. **Categories:** Drupal, Open Data, Steven De Costa, Thought Leadership **Tags:** CKAN, Thought Leadership --- ### [Building MDbox: An Open Access Simulation Data Repository on CKAN and AWS](https://linkdigital.com.au/news/2016/09/building-mdbox-an-open-access-simulation-data-repository-on-ckan-and-aws/) **Published:** September 21, 2016 **Author:** Steven De Costa **Content:** Link Digital is excited to start working with the ANU ([Australian National University](http://www.anu.edu.au)) on an innovative project called MDbox: The open access repository for molecular dynamics (MD) simulation data. Dr Karmen Condic-Jurkic (right) with Dr Megan O’Mara and Steven De Costa. *Image: Stuart Hay, ANU* Showing up in the spotlight of HealthHack in 2015, thanks to the initiative of Dr Karmen Condic-Jurkic, the [ANU Research School of Chemistry](http://chemistry.anu.edu.au/) has recently won funding for the establishment of MDbox — a cloud-based repository and analysis toolkit for molecular dynamics simulations. Vice-Chancellor [Professor Brian Schmidt](https://en.wikipedia.org/wiki/Brian_Schmidt), speaking on the $500,000 in new funding for innovation granted by ACT Government via the 2016-17 CBR Innovation Development Fund has said: > “ANU is proud to be at the centre of Australia’s innovative economy. The University has produced world-class technology from a base of fundamental research” Working with the ANU Research School of Chemistry, Link Digital will establish MDbox on Amazon Web Services, initially as a data discovery platform based on CKAN. MDbox will iterate over the months and years ahead to facilitate cloud storage solutions, high performance computational simulations, integrated molecular dynamics analysis tools and meta-analysis tools. Computational modelling is an essential part of experimental testing in almost every branch of science. It has become increasingly popular in chemistry and biology due to its intrinsic facility to accelerate the selection process of candidates during the design process of therapeutic drugs, catalysts, and materials. While supercomputer simulations are a great asset to the research process, they are costly to run and can take up a lot of computational cycles over days, weeks and months. Dr Karmen Condic-Jurkic, a Postdoctoral researcher and one of the project leaders, believes that sharing the already existing simulation data would result in a faster flow of ideas and innovations. This open data initiative is expected to provide enormous value for both academia and industry by boosting research productivity and creating new opportunities for cross-disciplinary research. Having solid experience in building Government open data portals , and with a globally recognised CKAN service, Link Digital considers the development of open access platforms to be both an innovative and challenging objective to accomplish. The establishment of MDbox as a [platform for supporting research simulations](https://www.youtube.com/watch?v=KG3SKaf7yEw) follows naturally from an earlier collaboration between Link Digital, the NCI ([National Computational Infrastructure](https://nci.org.au/)) and Amazon Web Services to deliver a proof of concept for Raijin in-a-box, funded by Intel in 2015. > For some time now we’ve been thinking about how to publish the full set of research artifacts needed to replicate and review work undertaken by labs, or to swap out data and reconstitute the research in a new context. MDbox will be a great opportunity for us to expand our established capability in both data discover platforms and the orchestration of clusters for super-computing workloads on Amazon Web Services. I’ve come to think of this, along with the publishing of code, as a [model for friction-less science](http://www.linkdigital.com.au/news/2015/12/is-there-a-model-for-friction-less-science). Executive Director of Link Digital, [Steven De Costa](https://www.linkedin.com/in/stevendecosta) Link is thoroughly proud to be part of this Australian innovation and is strongly convinced that MDbox will be a major breakthrough in the area of research chemistry. [Follow Link Digital on Facebook](http://www.facebook.com/LinkDigital/) to stay tuned for the updates on the project. **Categories:** Amazon Web Services (AWS), Higher Education/Research, Open Data, Steven De Costa, Thought Leadership **Tags:** CKAN, research data, Thought Leadership --- ### [Link Digital Delivers on White House Open Data Commitments](https://linkdigital.com.au/news/2016/09/link-digital-delivers-on-white-house-open-data-commitments/) **Published:** September 29, 2016 **Author:** Steven De Costa **Content:** Today [the White House](https://www.whitehouse.gov/) is assembling federal and private-sector leaders for the first-ever Open Data Innovation Summit, a follow-up event to the series of Open Data Roundtables that took place at the White House Executive Office earlier this year, concluding on 15 June. Over the last few years, the Administration, led by President [Barack Obama](https://www.barackobama.com/), has been intensely promoting and contributing to the concept of a transparent and collaborative government. Link Digital, represented by Executive Director Steven De Costa, was proud to join the participants of the 4th Open Data Roundtable in Washington. At this session, dedicated to Public-Private Collaboration, we made two comittments, now both delivered. Today’s follow-up summit will showcase best practices and solutions achieved by private and nonprofit organizations through the use of U.S. open Government data. The fact that for many private companies open data acts as a principal means of business development makes the improvement of its quality, accessibility, and cost-effectiveness a common goal both for entrepreneurs and government agencies. At June’s Roundtable session, Link Digital made two commitments we felt would assist the broader community of interest surrounding open data plaforms, specifically in relation to CKAN hosted platforms. **Commitment 1:** To publish, as open source, our recipe for building enterprise CKAN environments on Amazon Web Services. This is now delivered and [available on GitHub under our DataShades account](http://github.com/DataShades/ckan-aws-templates). Link Digital trades under [Data Shades](http://datashades.com/) for our Platform as a Service (PaaS) approach to providing CKAN hosting services globally. **Commitment 2:** To establish a CKAN extension which integrates with GitHub to allow for Code + Data to be made more discoverable on existing open data portals. This too is now delivered as an [apha release on GitHub](https://github.com/DataShades/ckanext-githubrepopreview). The CKAN extension provides open data platforms with a resource view for GitHub.com repositories, presenting some of the readily available statistics available via GitHub’s API within the portal and under the same context of related datasets. **Categories:** Government, Open Data, Steven De Costa, Thought Leadership **Tags:** CKAN, GitHub, Thought Leadership --- ### [Co-stewarding the CKAN Project is about delivering results, rewards and recognition.](https://linkdigital.com.au/news/2019/08/co-stewarding-of-the-ckan-project-is-about-delivering-results-rewards-and-recognition/) **Published:** August 6, 2019 **Author:** Steven De Costa **Content:** ## Reinvigorating with clear, dynamic and invested leadership Back in early June the [Open Knowledge Foundation](https://okfn.org/) (OKF) supported the [joint stewardship proposal](https://ckan.org/2019/06/10/introducing-bilateral-stewardship-for-the-ckan-open-source-project/) put forward by [Link Digital](https://linkdigital.com.au) and [Datopian](https://www.datopian.com). Being appointed a co-steward of the CKAN project allows Link to be a key part of ensuring the CKAN community thrives as an engaged and active group of believers. It also recognises Link’s strong connection to OKF in both principle based action and specific alignment to CKAN’s mission surrounding a community of open data advocates contributing toward an open data project. ## What does CKAN Stewardship really mean Put simply CKAN is a tool for data sharing. That ‘sharing’ is at the heart of its very beginnings and critical to its future. Being open source, it is supported and nourished by a broad community of active, informed and devoted stakeholders – the true believers. With OKF retaining a trustee role to ensure ongoing commitment to the mission, appointing a small, highly accountable and identifiable group of stewards to provide leadership was identified as a timely response. Together with Datopian we aim to bring about the best possible future for the CKAN project, it’s stakeholders and end users. It helps too that Link is one of the longest standing current CKAN contributors . A long time Gold Member of the CKAN Association, we have provided expertise across the steering group, community and technical teams, demonstrating an unfaltering commitment to CKAN’s growth and prosperity. As well as our ideas around working *with*, and *for* the community and, indeed, *building* the community, the CKAN co-stewards will address setting and implementing the technical direction of the project. ## Hitting the ground running alongside our stewarding buddies ![](https://linkdigital.com.au/wp-content/uploads/2019/08/Steven-and-Paul-in-Tel-Aviv.jpg)Steven De Costa and Paul Walsh at Paul’s family book store, [Hamigdalor](https://www.hamigdalor.co.il/), 13 June 2019Immediately following the bilateral stewardship appointment, Link Digital’s Managing Director, Steven De Costa and Datopian CEO Paul Walsh caught up in Tel Aviv to plan and bed down some exciting initiatives. A couple right off the bat include: **Call to action for Py3 nominations**. A first step came in mid June with the call for registrations from users, vendors and developers to support shipping CKAN 2.9 on Python3. If you’re just hearing about this now, it’s not too late to join the Py3 team. For developers willing, able and ready to contribute to the 2.9 release, the date for an upcoming Sprint will be locked in shortly. **Freshening up**. New branding and community development activities are on the 2020 horizon. **Investing from the get go!** As stewards we are delivering on an immediate $70k combined investment. As the two lead investors and curators of CKAN over the past 5 – 10 years, the Link Digital and Datopian co-stewarding appointment represents benefits for our clients and sets us apart from other CKAN vendors. Link Digital will shortly be contacting clients around their specific readiness in anticipation for the CKAN 2.9 release. Existing and new clients are welcome to [contact us](https://linkdigital.com.au/get-in-touch/) if you would like an obligation free assessment of your CKAN configuration and set of extensions. [Get in touch with our CKAN experts](https://linkdigital.com.au/get-in-touch/) **Categories:** All articles, CKAN, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Introducing Datashades.info, a CKAN Community Service](https://linkdigital.com.au/news/2019/10/introducing-datashades/) **Published:** October 4, 2019 **Author:** Steven De Costa **Content:** #### **Originally posted on Open Knowledge Foundation Blog ([blog.okfn.org](https://blog.okfn.org/))** #### **Do you use CKAN to power an open data portal? Take advantage of the latest open data initiative by Link Digital.** [Datashades.info](https://datashades.info/) is a tool designed to deliver insights for researchers, portal managers, and the wider tech community to inform and support open data efforts relating to data hosted on[ CKAN platforms](https://linkdigital.com.au/ckan/). [Link Digital](https://linkdigital.com.au) created the online service through a number of alpha releases and considers datashades.info, now in beta, as a long term initiative they expect to improve with more features in future releases. ![](https://linkdigital.com.au/wp-content/uploads/2019/10/Datashades-info-logo-1-1024x382.png)Specifically,[ Datashades.info](https://datashades.info/) provides a publicly-accessible index of metadata and statistics on CKAN data portals across the globe. For each portal, a number of statistics are aggregated and presented surrounding number of datasets, users, organisations and dataset tags. These statistics give portal managers the ability to quickly compare the size and scope of CKAN data portals to help inform their development roadmaps. Moreover, for each portal, installed plugin information is collected along with the relative penetration of those plugins across all portals in the index. This will enable CKAN developers to quickly see what extensions are the most popular and on what portals they are being used. Finally, all historical data is persisted and kept publically accessible, allowing researchers to analyse historical data trends in any indexed CKAN portal. [Datashades.info](https://datashades.info/) was built to support a crowd-sourced indexing scheme. If a visitor searches for a CKAN portal and it is not found within the index, the system will immediately query that portal and attempt to generate a new index entry on-the-fly. Aggregation of a new portal’s statistics into Datashades.info also happens automatically. Maximise the tool and gain interesting information with the following features: ## Globally Accessible open data With Datashades.info, you can easily access an index of metadata and statistics on CKAN data portals across the globe. To do this, simply type in the portal’s URL on the homepage then click “**Search**“. ![](https://linkdigital.com.au/wp-content/uploads/2019/09/Datashadesinfo2online-video-cutt.gif)## Integrated Values of All Metrics After entering a portal’s URL, you will be advised not to leave the page as Datashades.info loads its information. After a few seconds, you will be able to see a range of data on portal users, datasets, resources, organisations, tags and plugins. Portal managers can access these via the individual portal page found on the site. ![](https://linkdigital.com.au/wp-content/uploads/2019/09/Datashadesinfo3online-video-cutt-1.gif)## Easily-tracked Historical Data Want to revisit data you previously explored? The tool also keeps old data in a historical index which users can explore any time on any portal page or by simply clicking “**View All Data Portals**” on the homepage. ![Datashadesinfo1online](https://linkdigital.com.au/wp-content/uploads/2019/09/Datashadesinfo1online-video-cutt.gif) ## Crowdsourcing Datashades.info uses crowdsourcing to build its index. This means users can easily add any [CKAN data portal](https://linkdigital.com.au/news/2019/09/introducing-pre-built-ckan-delivered-by-link-digital-on-aws-marketplace/) not found on the site. To do this, simply search for a portal you know and it’ll be automatically added to the site and global statistics. As the project remains at a beta level of maturity, it is still wanting of improvements in many areas. But with the continuous feedback coming from the CKAN community, expect that more data and features will be added in future releases. For now, have a look around and stay tuned! **Categories:** All articles, CKAN, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Rising to address climate risks with AI-enhanced open source analytics and open data](https://linkdigital.com.au/news/2020/09/ai-enhanced-open-source-analytics-and-open-data/) **Published:** September 11, 2020 **Author:** Steven De Costa **Content:** The Linux Foundation (LF), recently announced their intent to form a new initiative called the LF Climate Finance Foundation (LFCF). The foundation is tasked with empowering investors, banks, insurers, companies, governments, NGOs, and academia with AI-enhanced open source analytics and open data to address climate risk and opportunities. Initial members include an interesting and diverse group of organisations including Allianz, Amazon, Microsoft, and S&P Global, and the planning team includes representatives from the World Wide Fund for Nature (WWF), Ceres, and the Sustainability Accounting Standards Board (SASB). The initiative will be fueled by open data and is evidence of the huge economic drivers surrounding climate risk, with the open data sector becoming more clearly a focus point for the financial organisations. In just the same way that financial risk markets evolved from the early corn exchanges into commodities exchanges and powerful derivatives markets, we are witnessing enormous investment in open data and the growth of industries surrounding the gathering, cataloguing and analysis of open data. The analysis of open data affords risk mitigation at scale, enabling governments and financial markets to mitigate long term risk. Link Digital has been a leading advocate and driver of open source tool sets for open data, as [co-steward of CKAN](https://linkdigital.com.au/news/2019/08/co-stewarding-of-the-ckan-project-is-about-delivering-results-rewards-and-recognition/) we’re at the forefront of enabling open data across different regions of the world. **Categories:** All articles, CKAN, Environmental/Climate Change, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Australian Public Service Launch Data Professionals Stream](https://linkdigital.com.au/news/2020/09/australian-public-service-launch-data-professionals-stream/) **Published:** September 18, 2020 **Author:** Steven De Costa **Content:** Earlier this month I was listening to an Audible reading of a Harvard Business Review article titled, “*The Best Data Scientists Know How to Tell Stories”,* by Michael Li 2015. The article covers how employers struggle to find the top 2% of STEM PhDs within a subset of candidates who are not only technically gifted, but who also understand, and can communicate the business value of their work. So, I was naturally interested when this week the Australian Public Service (APS), who are also a significant employer of STEM PhDs, formally launched the Data Professional Stream. It was announced by the APS Commissioner Peter Woolcott AO, who also confirmed the appointment of Dr David Gruen, Australian Statistician and head of the Australian Bureau of Statistics (ABS), as the inaugural Data Head of Profession. The Data Professional Stream will champion the uplift of baseline data capability across the APS, but put primary focus on those called to leverage sophisticated or specialist data capabilities. In conjunction with the launch, several prerecorded video presentations were made available, each giving context to the need for strong data capabilities within the APS. In one of these[ videos](https://youtu.be/J6xdxDTinvU) Alistair Campbell, the Assistant Secretary at the Department of Prime Minister and Cabinet, states, “*In 2030, just ten years away, I want to see our data professionals become the pre-eminent problem solvers of the Public Service. We can do this by bringing together the roles of data scientists and data engineers to also fulfil the role of translators.*” Recruiting and developing staff to hold strong capabilities in both data science and communication is a challenge across both the private and public sectors. With the launch of the APS Data Professional Stream we are seeing a positive step toward meeting this challenge. At Link Digital we often work with highly capable data practitioners who have identified the need for data catalog capabilities within their organisations and yet still need help to ‘sell’ their ideas internally. We’ve shared their disappointment at times when the value of important work hasn’t been fully appreciated across the entire organisation. From our observation, we predict that many organisations will benefit from there being more people around to translate that “smaller confidence intervals” usually means, “more confidence in our service”. *“Mary Wiley-Smith, Deputy Australian Public Service Commissioner, facilitates a discussion with Australian Public Service Commissioner, Mr Peter Woolcott AO, and Australian Statistician Dr David Gruen, to launch the APS Data Professional Stream and announce Dr Gruen as the first Head of the Data Profession.” Source: [](https://www.youtube.com/watch?v=r44mRz3tYF8)[ ](https://www.youtube.com/watch?v=r44mRz3tYF8)* **Categories:** Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Australian Online Hub Launched for Children's Cancer](https://linkdigital.com.au/news/2020/09/online-hub-launched-for-cancer-australia/) **Published:** September 25, 2020 **Author:** Steven De Costa **Excerpt:** We’re proud to have worked closely with Cancer Australia building the Online Hub, which offers advice and support for the families and friends of children living with cancer.  **Content:** Cancer Australia launched their [online hub](https://childrenscancer.canceraustralia.gov.au/) on Wednesday. We’re proud to have worked closely with Cancer Australia building the [Online Hub](https://childrenscancer.canceraustralia.gov.au/), which offers advice and support for the families and friends of children living with cancer. The website provides information about clinical trials and research, as well as links to resources for health professionals, researchers and the broader community. The CEO of Cancer Australia, Professor Dorothy Keefe highlighted that “*While more children are surviving cancer and childhood cancer is rare compared to adult cancer, it is still a leading cause of disease- related death for children in Australia”* *“A diagnosis of childhood cancer is an extremely challenging and confronting time for children, their parents, immediate and extended family. Facing such a diagnosis can be overwhelming and leave families with many questions and concerns.”* Link Digital has been working in partnership with Cancer Australia since 2017 and last year we collaborated to launch a fully redesigned website, as well as customised Drupal 7 based content management update of 10 separate sites and 32 mini-sites.Please share details of the [site](https://childrenscancer.canceraustralia.gov.au/) with any relatives, friends or colleagues who may be in the situation to need the support and guidance it offers. **Categories:** Drupal, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Join me at 2020 Connected Conversations](https://linkdigital.com.au/news/2020/10/join-me-at-2020-connected-conversations/) **Published:** October 22, 2020 **Author:** Steven De Costa **Content:** This Saturday, 24 October from noon, please join me and other panelists for a 2020 Connected Conversations roundtable discussion as we come together to explore the following big questions from a truly global perspective: ## **The New Public Dialogue** - What are the new ways of sharing ideas for change? - What’s working? And…? - What else do we need to make a real impact on climate, Covid-19 reset, the Global Goals and emerging global/local challenges? ## **The New Public Purpose** - What are the new ways we need to act together? - How do we mobilise resources, public will and unified approaches? - How do we create new value through more collaborative and responsive approaches? In a time of global crisis, 2020 Connected Conversations aims to showcase a critical mass of linked dialogues to also demonstrate to government and public institutions that grassroots conversation can make a valued contribution to shaping new ways forward. Aligned with the [UN75 global dialogue program](https://www.un.org/en/un75), the Asia-Pacific session I’m attending will be framed by the UN75 issues and will contribute to the [global insights capture](https://un75.online/) process. **Categories:** All articles, Environmental/Climate Change, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Strong Foundations for a Third Wave of Open Data](https://linkdigital.com.au/news/2020/11/strong-foundations-for-a-third-wave-of-open-data/) **Published:** November 20, 2020 **Author:** Steven De Costa **Content:** I read the The Foundational Four guide when it was first shared by [Deborah Anton](https://www.linkedin.com/posts/deborah-anton-338191112_foundational-four-activity-6683253327330983936-JzOg/), Australia’s Interim National Data Commissioner. To date Deborah’s Linkedin post has received 143 thumbs up, 8 claps of applause and one love heart (you might rightly guess who shared the love!). Five months on and I’m still feeling that love because the guide is a clear indication that open data programs are beginning to drive impact within Government in ways which will resonate for years and decades to come. The Four Foundations are – - Leadership: A senior leader is responsible and accountable for data across the agency - Data Strategy: An agency has a clear vision and plan for using data to achieve objectives - Governance: Mechanisms exist to oversee data management - Asset Discovery: Data assets have been identified and recorded The growth and level of professionalism exhibited through data management practices in the public sector have reached new levels, with notable examples such as the launch of the [Australian Public Sector Data Professionals Stream](https://linkdigital.com.au/news/2020/09/australian-public-service-launch-data-professionals-stream/). On a global level the Open Data Policy Lab recently suggested that we are now at the genesis of the [Third Wave of Open Data](https://opendatapolicylab.org/third-wave-of-open-data/#:~:text=The%20Third%20Wave%20takes%20a,inter%2Dsectoral%20collaborations%20and%20partnerships.) and have released a white paper positioning the third wave in more detail. > The Third Wave takes a much more purpose-directed approach than prior waves; it seeks not simply to open data but to do so in a way that focuses on impactful reuse, especially through inter-sectoral collaborations and partnerships. > > Source: I’ll come back to the subject of the third wave in a future blog, but I suggest it would be worth downloading and reading the article ([here](https://opendatapolicylab.org/images/odpl/third-wave-of-opendata.pdf)). **Categories:** All articles, CKAN, Government, Higher Education/Research, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Quick Update: CKAN 2.10 is here](https://linkdigital.com.au/news/2023/04/ckan-210-is-here/) **Published:** April 19, 2023 **Author:** Steven De Costa **Content:** [Link Digital](https://linkdigital.com.au/) is excited to announce the release of [CKAN 2.10,](https://ckan.org/blog/the-latest-ckan-release-is-here-say-hi-to-ckan-210) the latest version of the popular open-source data portal platform. This release results from a massive collaborative effort by project contributors, introducing new features and enhancements to improve [CKAN’s ](https://ckan.org/)security and customisation capabilities. The comprehensive [CHANGELOG](https://docs.ckan.org/en/2.10/changelog.html) provides a detailed list of all the changes and essential migration notes for site maintainers considering an update. While setting up[ CKAN ](https://ckan.org/)can be challenging, [Brett Jones,](https://www.linkedin.com/in/brett-jones-49369b8/) one of our DevOps Engineers and a [CKAN](https://ckan.org/) contributor, created a series of step-by-step installation videos available on Link Digital’s [YouTube channel](https://www.youtube.com/@link-digital). These videos guide users through each stage of the installation process, simplifying the process and helping users to set up [CKAN](https://ckan.org/) rapidly and effectively. [Brett ](https://www.linkedin.com/in/brett-jones-49369b8/)covers everything from installing [CKAN](https://ckan.org/) on Ubuntu 22.04 to setting it up on Mac OS BigSur. He also provides instructions on how to set up two critical [CKAN ](https://ckan.org/)features: DataStore and DataPusher. These features are essential for users to manage their data and make it accessible to the public. **Categories:** All articles, CKAN, Resources, Steven De Costa, Thought Leadership **Tags:** CKAN, ckan2.10, datapusher, datastore, installationguide, Thought Leadership, ubuntu --- ### [Link Digital Public Forum: opening the gateway to informed discussions](https://linkdigital.com.au/news/2023/07/link-digital-public-forum/) **Published:** July 28, 2023 **Author:** Steven De Costa **Content:** Following the positive response from our customer forums, we are delighted that we have now opened the forum to the public. This expansion aims to foster more inclusivity, allowing a wider range of individuals to join, participate, and contribute to our discussions. The public forum serves as a valuable platform for anyone to share their voice and champion essential topics within the open data community. Your active involvement can make a significant impact, and we look forward to hearing your insights and ideas! Initially, the Link Digital Customer forum served as an exclusive platform for our customers to showcase their exciting work. The spotlight presentations from our customers can be found on the [Link Digital YouTube channel.](https://www.youtube.com/playlist?list=PLNYR4MdBNnu9oR5TsGIPKhMbq8JmbGedc) These presentations stand as valuable resources, offering insights and innovative ideas for other organisations. Be sure to check them out and get inspired! A big thank you to the open data teams behind the [Victorian](https://www.youtube.com/watch?v=MvihnyeEStE&list=PLNYR4MdBNnu9oR5TsGIPKhMbq8JmbGedc&index=4&t=547s) and [Queensland ](https://www.youtube.com/watch?v=wwqLQoyTbjY&list=PLNYR4MdBNnu9oR5TsGIPKhMbq8JmbGedc&index=2&t=2s)state portals, the [Office of the National Data Commissioner](https://www.datacommissioner.gov.au), and the [New Zealand Ministry of Business, Innovation, and Employment](https://www.youtube.com/watch?v=_XqnZgl_rPE&list=PLNYR4MdBNnu9oR5TsGIPKhMbq8JmbGedc&index=1&t=1698s) for their contributions. But now, with the forum open to the public, we believe it will create an even more diverse and enriching experience. We welcome everyone to take part in the vibrant discussions. A special thank you goes out to our guest speakers, [Pia Andrews](https://www.linkedin.com/in/pia-andrews/) and [Amber Guette](https://www.linkedin.com/in/amber-guette-722711265/), who made the public forum even more captivating. Their contributions to the forum highlighted the value of the [Creative Bureaucracy Festival](https://creativebureaucracy.org) and Pia’s discussion on “Right Here, Right Now – A Public Servant Revolution” which l am sure left everyone inspired and ready to [join the 3.5%](https://www.bbc.com/future/article/20190513-it-only-takes-35-of-people-to-change-the-world). We can’t wait to continue these engaging discussions with you and welcome new voices to join us where our customers and external stakeholders can freely exchange diverse perspectives, inspiring collective innovation. For those who couldn’t attend the live sessions, don’t worry. You can watch the [recordings ](https://www.youtube.com/watch?v=TsSOhbgsHZs&list=PLNYR4MdBNnu-vHzvMk92VVjG5UZO9Ed5K&pp=iAQB)on demand on our [YouTube channe](https://www.youtube.com/@link-digital)l so you can catch up on the discussions. Thank you again to everyone for being a part of this meaningful event! **Categories:** All articles, Government, Open Data, Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** Thought Leadership --- ### [The open source software community: a vital ally of government on the road to Tallinn](https://linkdigital.com.au/news/2023/09/the-open-source-software-community-a-vital-ally-of-government-on-the-road-to-tallinn/) **Published:** September 5, 2023 **Author:** Andrew Nette **Content:** The [2023 Open Government Partnership (OGP) Summit in Tallinn, Estonia](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/), takes place at a time of both very real opportunities and serious threats to open government and the many civil society participants engaged with the [OGP](https://www.opengovpartnership.org/) to support it. As the [OGP Co-Chair Agenda](https://www.opengovpartnership.org/2022-2023-ogp-co-chair-agenda-government-of-estonia-and-anabel-cruz/), written by the host government and civil society activist [Anabel Cruz](https://www.opengovpartnership.org/people/anabel-cruz/), notes, the global situation now is radically different to that in which [OGP](https://www.opengovpartnership.org/) was founded in 2011. There are new threats: deliberate and systematic large-scale disinformation spread by malicious actors; a global lurch towards authoritarian styles of government; and a declining security situation, the war in Ukraine being the foremost of many examples. The world is also growing more polarised and distrustful. As the Australian communication firm Edelman states in its [Trust Barometer 2023](https://www.edelman.com/trust/2023/trust-barometer), a survey involving over 32,000 respondents in 28 countries, a ‘lack of faith in societal institutions triggered by economic anxiety, disinformation, mass-class divide and a failure of leadership has brought us to where we are today – deeply and dangerously polarised.’ While not all countries are experiencing this to the same extent, to a greater or lesser degree most are bound up in a ‘cycle of mistrust’ that is particularly targeted at government and media, now viewed by many as sources of unreliable information. This makes it difficult to act with the political unity we need to tackle the major global problems facing us, such as climate change or poverty. The opportunities, symbolised by gatherings such as [Tallinn](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/), include the growth and progress being made by the [OGP](https://www.opengovpartnership.org/) and the potential of technology to strengthen democracy and make governance and policy-making more transparent and accountable. One question that needs to be asked at [Tallinn](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/), however, is whether governments are making the most of the potential offered by data and digital to make open governance a reality. New forms of digital technology undoubtedly give governments the ability to collect more data on their citizens, which can be used to improve policy and service provision. But how can governments also use data and digital to engender greater civic participation and increase trust in government and its institutions? And what tools are available to help them do this? This is an issue that global digital services provider [Link Digital](https://linkdigital.com.au/) is keen to explore in [a day long side event it is sponsoring at the Tallinn gathering](https://okfn.org/events/the-tech-we-want-to-open-governments/). This will bring [Open Knowledge Estonia](https://okee.ee/) and [Open Knowledge Finland](https://www.okf.fi/) together with open knowledge experts and practitioners from around the world to discuss the future of government transparency, the role of civil society in helping to achieve it, and the digital technology solutions available to maximise the possibilities of the [OGP](https://www.opengovpartnership.org/) and its support of open government. The rise of data as a key currency of the 21st century, a trend driven by the digitisation of nearly all key facets of life, has had numerous impacts. One of these is a reconfiguration of how many governments understand their data and digital operations and, parallel with this, the growth of citizens accessing more government information and services digitally. Particularly spurred on by the response to the COVID-19 pandemic, data sharing within and between governments and between governments and the public is increasingly seen as positive in the context of developing and improving government services. While there are several ways in which this sharing is happening, the main form is through open data portals. These are front-line interfaces that bridge data providers and users, helping to ensure that data is not just accessible but usable. In the context of Australia, where [Link Digital](https://linkdigital.com.au/) is based, open data portals have been accompanied by a range of other reforms focused on improved data asset discovery, a ‘digital by design’ approach to deliver policies and services for people and business, and regulation of data sharing and developing public service capabilities. The governments that will be attending [Tallinn](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/) are doing so because they want to do better in terms of open government and protect or expand the space for local and national civil society actors to be involved. All of them, however, are at different stages of this effort and many face a range of challenges in terms of realising this project: resourcing, constraints relating to political culture, institutional or bureaucratic issues, historical factors, or external challenges. The key issue for the [Tallinn summit](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/) is how to translate the goodwill and commitments made by governments in national and local plans into concrete action on the ground. The possibilities of data sharing within and between governments and between governments and the public is a crucial part of this. Data sharing can break down silos within government and, crucially, empower governments and their citizens with digital service provision from a common and trusted source. But not all [OGP](https://www.opengovpartnership.org/) participants are resourced to take advantage of this evolving digital ecosystem, and the opportunities for data sharing presented by it. The [Tallinn summit](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/) needs to discuss how to help those governments, while encouraging those who are engaged in data sharing to align their policies in such a way that these activities can be used to put power in the hands of citizens and, in doing so, improve transparency, accountability and civic participation. [As the OGP itself states in its 2023-2028 Strategy](https://www.opengovpartnership.org/strategy/), ‘when civil society is involved in designing and implementing [OGP](https://www.opengovpartnership.org/) action plans, commitments are more ambitious, are better implemented, produce more changes in government practices, and result in better outcomes for people.’ [Link Digital](https://linkdigital.com.au/) contends that a deeper engagement between governments and the open source software community, especially in relation to [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN), presents one opportunity to deliver on improved [OGP](https://www.opengovpartnership.org/) commitments. ## **Comprehensive Knowledge Archive Network: A vital open data sharing tool** Launched in 2006, [CKAN ](https://ckan.org/)is a piece of open-source software that can be configured and set up to function as a data platform. CKAN[ ](https://ckan.org/)is based on the principle that open data is a public good that should be non-right restricted and easily transferable, a process that creates more value the further data is shared. [‘](https://ckan.org/) is also non-commercial, which allows the project to maintain its direction without being swayed by external financial interests. This makes [CKAN](https://ckan.org/) a powerful tool for increasing government efficiency by making data more discoverable to independent analysis in ways that go far beyond the original purpose for which it was collected. Open data can help government institutions within a country exchange data faster and more efficiently. Instead of going through the complex bureaucratic internal process of requesting data from another institution within the country, openly published data can be accessed immediately saving time and taxpayers money. Corporates can use [CKAN](https://ckan.org/) to register and manage internal data assets. Non-government organisations can use it as a free and open source tool to publish operational data and broaden their user communities. And the scientific community can utilise it to enable public data repositories in areas of active research. There are many ways to measure [CKAN’s](http://ckan.org) impact. One is obviously usage. Put very simply, if software is being used it means it is needed and people find value in it. In the context of the deliberations taking place at [Tallinn](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/), and the need for greater collaboration between governments and civil society, [CKAN’s ](http://ckan.org)growing role in the digital ecosystem is evidenced by the fact that it serves as the key component of some of the largest and most successful open data portals around the world. [Recent research was undertaken on a set of nearly 400 regularly updated CKAN data portals of different sizes in 59 countries](https://civicdataecosystem.org/2023/06/19/analysis.html). These are spread across six major continents, with Brazil and the United States having the largest prevalence, followed by Argentina, Australia, Canada, Germany, the UK, Spain, Italy, and Japan. They include the [European Union’s Open Data Portal](https://data.europa.eu/en), the [United States Open Data Portal](https://data.gov/), the [United Kingdom’s National Health Service](https://www.nhs.uk/), and [Open Africa](https://africaopendata.org/), the largest repository of data on the African continent. Another indicator of [CKAN’](https://ckan.org/)s real world impact is that the platform was recently awarded the status of being a [Digital Public Good](https://digitalpublicgoods.net/) (DPG) by the [Digital Public Goods Alliance](https://digitalpublicgoods.net/). This was a recognition of [CKAN’s](https://ckan.org/) value as a driver of positive change in helping to attain many of the Sustainable Development Goals put forward by [United Nations (UN)](https://www.un.org/en/), themselves a key OGP partner. [CKAN](https://ckan.org/) is currently used by many multilateral organisations like the [UN Refugee Agency](https://www.unhcr.org/), the [United Nations Office for the Coordination of Humanitarian Affairs](https://www.unocha.org/), [World Food Program](https://www.wfp.org/) and the [Food and Agriculture Organisation](https://www.fao.org/home/en). [CKAN’s](https://ckan.org/) recognition as a DPG is also associated with its use by philanthropic organisations and by grassroots civil society movements like [Code For Africa](https://github.com/CodeForAfrica/), [Civic Data Lab](https://civicdatalab.in/) and [Digital Fems](https://digitalfems.org/). ## **The open source software community: amplifying open government principles** Data management platforms, based on open source technology such as [CKAN](http://ckan.org), have the potential to provide real world benefits over the long term as digital public infrastructure. They are a viable, low risk and long term investment for government and civil society organisations, something that is not common in the dynamic world of technology. And they provide a tangible way for civil society to keep governments open and ensure they are accountable for the decisions they make. There is a core development team that contributes to keep the [CKAN](http://ckan.org) software in good shape. This is work that essentially never stops, meaning that [CKAN](http://ckan.org) is on a continuous improvement journey, with each successive iteration of the software looking at improving its efficiency, performance, stability, interaction, and usability. [Link Digital](https://linkdigital.com.au/) is what is referred to as a co-steward for [CKAN](http://ckan.org) and serves to help coordinate CKAN related activities that maintain the project’s direction and momentum. This role includes assisting with research in the lead-up to the release of the next version of [CKAN – CKAN 3.0.](https://ckan.org/blog/the-ckan-30-team-is-formed-welcome-to-dragan-and-svetozar) This work involves consultation with users and operators in the CKAN community to gather feedback on how to improve the technical aspects of the platform, as well as how it can better meet the needs of its diverse and geographically spread out community and improve [CKAN’s](http://ckan.org) effectiveness as an open data platform. The movement around [CKAN](http://ckan.org) comprises an expanding installation base of users and contributors, including individuals from the private and community sectors, academia and government. [Link Digital](https://linkdigital.com.au/) would encourage the [OGP](https://www.opengovpartnership.org/) and its government members to view this network as an active civil society group that can amplify [OGP’s](https://www.opengovpartnership.org/) aims and principles and promote greater government transparency and accountability. Parallel with their increasing use of data, many governments are generating a need for skills and competencies in the data and digital space and introspecting organisational improvements to meet challenges. While this is important, a purely top down version of data and digital governance misses out on the benefits that can be accrued from adopting a more collaborative approach that fully engages a much broader range of stakeholders, among them civil society. This includes the fluency that comes with new forms of working and collaborating on data. A closer engagement with groups such as the open source community around [CKAN](http://ckan.org) can strengthen government by enabling it to engage with data and digital initiatives that defy traditional boundaries between government and civil society. Direct benefits from this will directly flow back to the governments and their public servants in the form of exposure to new talent, and new skills, ideas and partnerships. [Link Digital](https://linkdigital.com.au/) would argue that in addition to energising government and building new relationships and ways of working, such a strategy points a way forward for how governments can use their data and digital transformation to help counter the broader societal threat posed to democracy by disinformation and rebuild public trust in the institutions of government. While the advantages of the data and digital transformation sweeping much of the world may be obvious to those attending the [OGP Summit](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/), it is important to bear in mind that the benefits are arguably far less clear to many in our communities. Open data and data sharing have created new opportunities in terms of keeping governments accountable and improving policy outcomes, but government held data has also engendered mistrust by exposing people to major risks related to data privacy, consent, surveillance and identity theft. Broader government engagement with platforms such as [CKAN](http://ckan.org) and the collaborative community around it, can not only provide governments with powerful technological tools for delivering open data and digital initiatives. It will help them to develop a stronger values framework that embeds data and digital initiatives much more firmly as part of a mission to improve trust in government and inoculate public institutions from the threat of disinformation. You can learn more about the [OGP Summit](https://www.opengovpartnership.org/events/2023-ogp-global-summit-tallinn-estonia/ "OGP Summit"), the [CKAN project](https://ckan.org "CKAN project") and please do [reach out to us at Link Digital](https://linkdigital.com.au/get-in-touch/ "Get In Touch") to discover how you can leverage CKAN and other open source technologies for your own data and digital initiatives. **Categories:** All articles, CKAN, Environmental/Climate Change, Government, Open Data, Technology Infrastructure **Tags:** 2023 open government partnership, Estonia, Government, OGP, open data, opengovernment, opensource, Tallinn, TRUST --- ### [Open data and building public trust in Australia and Canada](https://linkdigital.com.au/news/2023/09/open-data-and-building-public-trust-in-australia-and-canada/) **Published:** September 12, 2023 **Author:** Andrew Nette **Excerpt:** Link Digital, a proud supporter and sponsor of the Canadian Open Data Society. Link Digital is the trusted CKAN and open data portal experts by Living Lakes Canada, and the University of Manitoba's Canadian Watershed Information Network. **Content:** *Published in September 12, 2023* Link Digital Chairman [Steven De Costa](https://www.linkedin.com/in/stevendecosta/) will [be keynote speaker at a forum this evening in Toronto, Canada,](https://www.eventbrite.ca/e/canadian-open-data-society-link-digital-present-an-open-data-revolution-tickets-694191093247?aff=oddtdtcreator) co-hosted alongside the [Canadian Open Data Society](https://www.opendatasociety.ca/). The event, which will take place in the evening of Tuesday, September 12 (Toronto time), will focus on open data as an ecosystem and as a force for good in both countries. Link Digital is a co-steward of the [Comprehensive Knowledge Archive Network (CKAN)](https://ckan.org/) Project, a widely used open source software for open data portals, and it has very deep experience with open government and open data sharing and policies at the federal and state level levels in Australia. [Steven](https://www.linkedin.com/in/stevendecosta/) and Link Digital CEO [Marc Evans](https://www.linkedin.com/in/mrmarcevans/) are in Canada this week to celebrate the company’s expansion into that market. As part of the expansion decision Link Digital has studied the approaches of the Canadian and Australian governments in the areas of digital government and data sharing, to help us understand how to use our local experience to add the best value in the Canadian context. The [Canadian Open Data Society](https://www.opendatasociety.ca/) event will provide a chance for participants from government, the business community and not for profits to learn what governments in Australia and Canada are doing in open data and data sharing, what the benefits have been and how quality open data can be used to build public trust. Link Digital looks forward to the discussion and hopes the forum is the start of a broader dialogue on the issues involved. Steven will be joined by two speakers. [Cara Scarfone](https://www.linkedin.com/in/carascarfone/) of [Treasury Board Canada](https://www.canada.ca/en/treasury-board-secretariat.html), who will discuss speaking on Canada’s open data commitments in the [*2022-24 National Action Plan on Open Government*](https://open.canada.ca/en/content/national-action-plan-open-government) and what’s new in federal open data in Canada. [Paul Connor](https://www.linkedin.com/in/paulconnorincanada/), Executive Director of the [Canadian Open Data Society](https://www.opendatasociety.ca/), a membership-based non-profit that hosts the annual [Canadian Open Data Summit](https://www.opendatasummit.ca/) (which will take in Victoria, British Columbia, on November 23rd and 24th this year). Paul will discuss the Society’s current project of mapping open data ecosystems across national, provincial, territorial and municipal governments in Canada, as well as in civil society and the private sector. **Categories:** All articles, Amazon Web Services (AWS), CKAN, Drupal, Environmental/Climate Change, Government, Technology Infrastructure **Tags:** CKAN, open data --- ### [Countering large scale disinformation campaigns in election contexts: is there a role for open data in the fight?](https://linkdigital.com.au/news/2023/11/countering-large-scale-disinformation-campaigns-in-election-contexts-is-there-a-role-for-open-data-in-the-fight/) **Published:** November 13, 2023 **Author:** Andrew Nette **Content:** Is there a role for open data in helping to inoculate electoral processes from large scale malicious disinformation? And can this be done in such a way that it reinforces and enhances informed debate and political participation, rather than hindering or replacing it? For [Link Digital](https://linkdigital.com.au/) and its work using data to solve real world problems, this question was prompted by the recent failure of a national referendum to agree to enshrine an Indigenous Voice in Australia’s constitution. While many reasons have been put forward for the result, one factor was certainly the deluge of deliberate disinformation spread amongst the voting public. Many countries have been contending with deliberate, large scale disinformation campaigns waged by malicious actors. But its large scale application in the recent Voice referendum signals a new and disturbing development in the Australian context. Exactly how widespread was the problem? An [October 22nd open letter](https://www.instagram.com/p/CyuOp32hUWe/?hl=en&img_index=1) distributed by the Indigenous leaders behind the [Uluru Statement](https://ulurustatement.org/the-statement/view-the-statement/), the document that originally put forward the Voice proposal, argued that ‘the scale of deliberate disinformation and misinformation \[during the referendum\] was unprecedented, and it proliferated, unchecked, on social media, repeated in mainstream media’. Well before the official referendum campaign, the [Australian Electoral Commission](https://www.aec.gov.au/) (AEC), the statutory body that oversees Australia’s electoral system, was being tagged in over 100,000 social media posts a week. This included false claims the AEC was trying to rig the referendum by coercing dementia sufferers to vote in favour of the Voice and deliberately throwing out No ballots.1 In response, the AEC undertook what for it was a new strategy of publicly countering public disinformation during the campaign. While certainly worthy, this task was described in one news story as ‘like a man standing with a backyard hose, waving it at an inferno.’2 In a report released in August, the [threat analysis division of the American consultancy Recorded Future](https://www.recordedfuture.com/research/insikt-group) pointed to the existence of a deliberate effort to manipulate the public to vote against constitutional change. It claimed that most of the manipulative content around the vote was produced by ‘conspiracy theorists, political activists, and ideological groups’ and possibly at least one overseas government actor.3 Reporting by the [*Guardian Australia*](https://www.theguardian.com/au) online newspaper later highlighted what it claimed was a lack of transparency around some of the interests behind the campaign against constitutional recognition.4 Australia has taken some steps to counter the problem of large scale misinformation campaigns. Since mid-2022 the AEC has chaired an [Electoral Integrity Assurance Taskforce](https://www.aec.gov.au/about_aec/electoral-integrity.htm). The Taskforce’s website states that ‘threats to electoral integrity can come in the form of cyber or physical security incidents, misinformation or disinformation campaigns, and through perceived or actual interference in electoral processes.’ And the national government recently released an [exposure draft](https://www.infrastructure.gov.au/have-your-say/new-acma-powers-combat-misinformation-and-disinformation) of a proposed *Communications Legislation Amendment (Combating Misinformation and Disinformation) Bill 2023.* A brief overview of the available literature would appear to indicate that efforts to use open data to counter disinformation in electoral contexts have so far mainly been targeted at less economically developed countries. This is not necessarily because these countries are in any sense less innately democratic than many developed nations, although some do have an existing or previous history of authoritarianism and overt or covert repression that discourages independent monitoring of polls. These efforts are more a recognition that economic and technological restraints, including low digital bandwidth, reduce the ability of some governments to allocate resources to election management and make electoral related data widely and easily available to the public. [Freedom House’s](https://freedomhouse.org/) [Election Watch for the Digital Age website](https://freedomhouse.org/report/election-watch-digital-age) has an election vulnerability index for several countries – not all of which could be considered economically underdeveloped – that assesses them against criteria mitigating against free and fair elections and the availability of data openly related to electoral processes. These include vulnerability to internet disruptions, blocking of websites, state control of information, laws criminalising online activities, and cyberattacks against civic actors. The National Democratic Institute’s (NDI) [Beyond Transparency: Planning, Attaining and Using Open Election Data in Citizen Election Monitoring initiative](https://www.ndi.org/publications/beyond-transparency-planning-attaining-and-using-open-election-data-citizen-election) has applied open data principles to various stages of the electoral process in [Latin ](https://openelectiondata.net/en/guide/country-examples/)America and the [Pacific](https://www.spc.int/updates/blog/partners/2022/02/promoting-election-integrity-through-open-data). Influenced by the [Third Wave of Open Data](https://opendatapolicylab.org/third-wave-of-open-data/), the NDI defines electoral data as open ‘when it is released in a manner that is [timely](https://openelectiondata.net/en/guide/principles/timely/), [granular](https://openelectiondata.net/en/guide/principles/granular/), [available for free on the internet](https://openelectiondata.net/en/guide/principles/available-for-free/), [complete and in bulk](https://openelectiondata.net/en/guide/principles/complete-and-in-bulk/), [analyzable](https://openelectiondata.net/en/guide/principles/analyzable/), [non-proprietary](https://openelectiondata.net/en/guide/principles/non-proprietary/), [non-discriminatory](https://openelectiondata.net/en/guide/principles/non-discriminatory/) and available to anyone, [license-free](https://openelectiondata.net/en/guide/principles/license-free/) and [permanent](https://openelectiondata.net/en/guide/principles/permanently-available/).’5 Categories of data include electoral boundaries, voter registration, polling station locations, polling results, political party and candidate registration, and information about election management bodies and where to register a complaint. The NDI provides educational materials and tools based on these open data principles that aim to enable information to be gathered by citizen monitors without physical observation.6 ‘Open election data is comprehensive, external information that can be gathered without physical observation, thereby providing monitors with additional context that can sharpen their analysis and bolster their observation efforts at minimal costs.’7 Developed economies have adopted a range of responses to large scale disinformation, including laws against the deliberate spread of disinformation and countering foreign interference in elections, regulation of social media and online political advertising, and public media literacy campaigns. In the wake of COVID-19 and the war in the Ukraine, the [European Union’s](https://european-union.europa.eu/index_en) attempts in this area have sought to strike a balancing act between what has been referred to as ‘securitization’, ‘which understands the problem as a threat to democracy that legitimizes “exceptional decision-making” from a hard power perspective,’ and ‘self-regulation and voluntarism of digital platforms with a clear orientation towards soft law and minimal intervention.’8 Among the key methods of online content manipulation related to electoral processes, [Freedom House](https://freedomhouse.org/) identifies propaganda, outright fake news, paid commentators, bots (automated accounts), and the hijacking of real social media accounts.9 And more recently it has highlighted the growing influence of Artificial Intelligence, which it argues threatens to supercharge online disinformation around election campaigns.10 A 2019 report by the Australian Parliament notes that a key challenge in responding to disinformation ‘is the complex, overlapping nature of the problem—which involves issues pertaining to cybersecurity; national security; privacy; electoral integrity; media and advertising standards; transparency; and media literacy. Any effective response will need to account for these various aspects.’11 This points to the importance of much larger shifts in the digital ecosystem – the context within which the majority of disinformation propagates One example is what appears to be a deliberate move on the part of key social media platforms, such as X/Twitter, YouTube, TikTok, and Facebook, away from the stated purpose of sharing accurate news and helping users understand what is going on in the world.12 Discussing the role of journalist fact checkers in the 2022 Philippines national election, a campaign deluged in online disinformation, academic [Ma. Diosa Labiste](https://up-diliman.academia.edu/DiosaLabiste) makes a point highly relevant to efforts to counter disinformation more widely: ‘The challenge of battling election-related disinformation is how to hold candidates accountable for the truthfulness of their statements when there are no clear disincentives against disinformation.’13 One project that seeks to use open data to create a space in which truth can be protected and claims made by political interests can be independently verified, is the [Transparency International](https://www.transparency.org/en) (TI) [Integrity Watch Data Hub](https://data.integritywatch.eu/). This online portal takes publicly available datasets – otherwise often scattered and difficult to access – including asset and income declarations for politicians and high-ranking public officials, political donation and lobby registers, etc, and makes them easily searchable. Part of a longer term TI project, the Hub seeks to provide ‘a one-stop overview’ of harmonised datasets which now covers 15 EU member states, and work is currently underway to expand this to include data from another five nations in the Balkans. Directly flowing from this project, TI has been working with the [Government Transparency Institute](http://www.govtransparency.eu/) and the [Organization for Security and Co-Operation in Europe](https://www.osce.org/odihr) on recommendations for standards regarding open data sets that establish links between private commercial interests and politicians that may influence their statements and voting record.14 While this does not directly relate to deliberate disinformation in an electoral context, as Jon Vruchi, TI’s Thematic Lead on Political Integrity, wrote in a 2019 article: ‘We can only monitor and promote political integrity if we know the private financial interests of our politicians, who has access to political decision-making, and the means through which they gain such access. This is where data comes in.’15 The aim is ‘to identify and reward integrity wherever we see it,’ and vice versa, identify and enable the shaming of corrupt practices. Another relevant example occurred during the Swiss national elections in October of this year. There is no public funding of political parties in Switzerland and all politics is dependent on private donations. Several organisations used publicly available data to create an easy to use open data portal called [M](https://moneyinpolitics.ch/)[oney in Politics Project](https://moneyinpolitics.ch/), which seeks to illuminate the connections between money and Swiss politics. It included data from the Swiss Federal Audit Office that is otherwise difficult to interpret, not cleaned or easily searchable and which by law is withdrawn from public view after five years and placed into Federal Archives.16 In the context of these examples, it is also worth mentioning the [Open Knowledge Foundation’s initiative to build Digital Public Infrastructure for Electoral Processes](https://okfn.org/en/projects/digital-public-infrastructure-for-electoral-processes/). This aims to create open by design technology that can be reused to make democratic processes more trustworthy, resilient, and transparent in relation to processes such as candidate registration, data on polling stations, and the publications and archiving of results. Of course, the TI and Swiss initiatives would run into barriers in the Australian context, such as poor data quality. Although improved transparency and real time disclosure of political donations is currently being examined by a national parliamentary inquiry, as things stand, our national political donation laws maintain that political donations below $15,200 do not have to be disclosed until well after the election. But both examples point to the potential value of open data solutions in helping fact-check statements made by politicians and related interests in electoral contexts. Next Thursday, 23 November, Link Digital Chair Steven De Costa will deliver a keynote at the [Canadian Open Data Summit](https://www.opendatasummit.ca/), ‘The Architecture of Trust: Open and Honest Data’. This will follow an Executive Briefing on the 22nd of November, where De Costa will make the case for establishing a ‘Policy to Practice Accelerator Program’. Both sessions are, in part, a response to how our contested information spaces are creating a fundamental challenge for the protection of our civic spaces. --- 1 Henry Balot, “Indigenous voice: electoral commission launches campaign to combat misinformation and confusion,” *The Guardian Australi*a, April 12, 2023, 2 Linton Bessor, “The Voice campaign was infected with disinformation: Who’s in charge of inoculating Australians against lies?” Australian Broadcasting Corporation, October 17, 2023, 3 Insikt Group, *Malign Narratives Oppose “the Voice” Ahead of Australia’s Referendum*, (Somerville Massachusetts, Record Future, 2023), page 1, 4 See Josh Butler, “Indigenous voice: no campaign’s deep links to conservative Christian politics revealed,” *The Guardian Australia*, July 13, 2023, ; Ariel Bogle and Sarah Basford Canales, “Revealed: the secretive rightwing firm providing ‘clout’ for voice no campaign,” *The Guardian Australia*, October 13, 2023, 5 “Beyond Transparency: planning, attaining, and using Open election data in citizen election monitoring,” National Democratic Institute, October 6, 2021, 6 Open Election Data Initiative, United States Agency for International Development, National Democratic Institute and Google, accessed November 6, 2023, 7 Julia Brothers, *Beyond Transparency:* *Planning, Attaining, and Using Open Election Data in Citizen Election Monitoring*, (Washington D. C, National Democratic Institute, 2021), page 8. 8 Ruth-Marie Henckes, Lucio Posteraro, Tonusree Basu, Helen Turel and Maria Koomen. “Five Ways to Embed Open Gov Values in Online Political Advertising Regulation,” Open Government Partnership, April 14, 2021, 9 Adrian Shahbaz and Allie Funk, Digital Election Interference: Freedom on the Net 2019 Key Finding: Politicians and hyperpartisans use digital means to manipulate elections, Freedom House, accessed November 6, 2023, 10 *Freedom on the Net, 2023: The Repressive Power of Artificial Intelligence*, (Freedom House, 2023). 11 Luke Buckmaster and Tyson Wils, Social Policy, ‘Responding to Fake News,’ in *Briefing Book: Key Issues for the 46th Parliament* (Canberra: Department of Parliamentary Services, 2019), 23. 12 Cam Wilson, “Israel-Palestine is the final nail in the coffin — social media can no longer inform us,” *Crikey*, October 25, 2023, 13 Ma. Diosa Labiste, “Fact-checking in the Philippines: The Quest to End Disinformation in Elections,” Fulcrum, December 13, 2023, 14 Jon Vrushi, “Open Data and Political Integrity: What we learned from a data dive,” Transparency International, October 30, 2019, 15 Ibid. 16“About”, Money in Politics, accessed November 6, 2023, **Categories:** All articles, Government, Open Data **Tags:** open data --- ### [Reflecting on International Open Data Week](https://linkdigital.com.au/news/2024/03/reflecting-on-international-open-data-week/) **Published:** March 13, 2024 **Author:** Kate Sampher **Content:** If you answered yes to either of these questions, you’re already aware of the power of data in informing your decisions. Data that can be freely used, re-used and redistributed by anyone is called open data. Whether you’ve been using data as an individual or through your organisation, it’s crucial to become familiar with open data and advocate for it when appropriate, because this is how both the power and the value of data become a foundation of our society. This is why the [International Open Data Week, which took place from March 2nd to 8th](http://opendataday.org), was such an important event. Last week’s celebration brought together individuals from all corners of the globe, united in their commitment to advance open data initiatives. As a co-steward of the [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN), [Link Digital](https://linkdigital.com.au/) is proud to highlight what was for us one of the standout moments from the week, the [CKAN Demo Days](https://ckan.org/blog/ckan-demo-days-on-open-data-day). These allowed contributors from diverse backgrounds to share stories, projects, and insights about CKAN, and showed the immense impact that open source software such as CKAN can have once it is deployed and hosted on a web server, as an open data platform. [A virtual discussion hosted by Link Digital last week](https://www.youtube.com/watch?v=H1I3nHyBZhg&list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj&index=14&t=25s) included [our CKAN Open Data Day Demo Play List](https://www.youtube.com/playlist?list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj). “What does this experiment represent?” asked [our Chair and Executive Director, Steven De Costa](https://www.linkedin.com/in/stevendecosta/?originalSubdomain=au) during the live recap of the videos gathered for this play list. The initiative “came back with a much stronger response than the signal I put out. The folks who provided the videos have come back with stuff that I wouldn’t have been expecting and that I’m really impressed by, and I want to keep this going… How do we get more vendors like [Link Digital](https://linkdigital.com.au/) publishing videos from their own staff, from their own contributors to talk about why they understand that open data is important and why it locks into an open source product like CKAN?” Thus, from [real-world applications](https://linkdigital.com.au/case-studies/) to [technical ](https://github.com/ckan)scenarios, participants in [Link Digital’s](https://linkdigital.com.au/) CKAN Demo Days Play List demonstrated the many ways that open day can be used. These videos, which can all be viewed on [Link Digital’s YouTube Channel here](https://www.youtube.com/playlist?list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj), included: ## **Selecting Different Baby Names with CKAN** [Link Digital’s](https://linkdigital.com.au/) Head of Product Owners, [Iaroslav Pereiaslovets](https://www.linkedin.com/in/iaroslav-pereiaslovets-a9053258/?originalSubdomain=au), shared his experience of selecting a unique baby name using open data and CKAN. He used the data from the New South Wales Government’s open data portal, [Data.NSW](https://data.nsw.gov.au/ "Data.NSW"), to avoid common names and chose the name Marcus for his son. You can see how he did it by [watching this video](https://www.youtube.com/watch?v=ZJ8xCYIlU08&list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj&index=10&t=5s&pp=gAQBiAQB). ## **A Ukrainian’s Perspective on Open Data and CKAN** [Aleksey Pavlyuk](https://www.linkedin.com/in/pavlyukalexey/?originalSubdomain=it), Operations Manager at [Link Digital](https://linkdigital.com.au/), highlighted how open data democratises information, enabling citizens, researchers, and policymakers to make more informed decisions. [He specifically mentioned the role of platforms like CKAN in facilitating the use and accessibility of open data](https://www.youtube.com/watch?v=08NtymwlGQ0&list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj&index=1&t=18s&pp=gAQBiAQB). ## **CKAN Sync on Drupal** CKAN expert Sergey Shchedrin walked us through the recently registered CKAN synchronization module, now available on [Drupal.org](https://www.drupal.org/link-digital). The module allows you to connect your Drupal site with any CKAN open data portal via REST API. The module also allows a Drupal site to share the menu structure with CKAN or any other portal via a REST endpoint. [Watch the video.](https://www.youtube.com/watch?v=Asadupx9kDk&list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj&index=2&t=130s&pp=gAQBiAQB) ## **CKAN Portals on Datashades.info** [Datashades.info](http://datashades.info) was built as an experiment by [Link Digital](https://linkdigital.com.au/) to demonstrate value to those who want to use CKAN by creating an index of all functioning CKAN URLS over time. [In this video](https://www.youtube.com/watch?v=nhWb-N45Gog&list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj&index=4), [Karina Arro](https://www.linkedin.com/in/karina-arro-90586b125/?originalSubdomain=ph), who manually triggers the indexing on each portal monthly, explained how she does this and talked about the story behind Datashades.info. ## **Consensus-driven decision-making @ CKAN** [Alex Gostev](https://www.linkedin.com/in/alexgostev/?originalSubdomain=no), one of the CKAN experts, explained the role of open source software in helping to create inclusivity, equity, and group cohesion through making data more open and transparent. [In this video he also emphasized that anyone can contribute and be part of the future of CKAN.](https://www.youtube.com/watch?v=j7lRgzrUtdc&list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj&index=6&t=141s) ## **Installing CKAN on GitHub Codespaces** [Brett Jones](https://www.linkedin.com/in/brett-jones-49369b8/?originalSubdomain=de), another CKAN contributor, demonstrated how to install [CKAN on GitHub Codespaces](https://www.youtube.com/watch?v=KGTyX3Nx9IU). This is a remote development environment that allows users to develop within a browser or connect their integrated development environment to a cloud-based environment. If you are interested in learning more from Brett’s expertise, you can [check out his other CKAN Installation Walkthroughs.](https://www.youtube.com/playlist?list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx) ## [**Médecins Sans Frontières** ](https://www.msf.org/) **(MSF) Data Sharing Platform on CKAN** [In this video](https://www.youtube.com/watch?v=s91MtKy3kEg&list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj&index=6), [Rupak Chatterjee](https://www.linkedin.com/in/rupakchatterjee/?originalSubdomain=au), one of [Link Digital’s](https://linkdigital.com.au/) Product Owners, talked about the data portal project he worked on with MSF. This shows the importance of investing in open-source software solutions to build projects to help achieve public good. ## [**CKAN Delivered by Link Digital on Amazon Web Services (AWS) Marketplace**](https://linkdigital.com.au/aws/) [Joel Wigley](https://www.linkedin.com/in/joel-wigley-32761911a/?originalSubdomain=au), [Link Digital’s](https://linkdigital.com.au/) Systems Operations Lead, has been providing support for CKAN over multiple environments worldwide, but particularly via AWS Cloud. [In this walkthrough, he shows how to get CKAN up and running using the freely available Amazon Machine Image maintained via AWS Marketplace](https://www.youtube.com/watch?v=nXT8cNFr76I&list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj&index=8). All these open data advocates came together during International Open Data Week to demonstrate the importance of open data in shaping a more transparent and informed society. With so much misinformation and disinformation happening on the Internet, hearing about such projects from so many different individuals gives hope to future generations. We look forward to making [CKAN Demo Days](https://ckan.org/blog/ckan-demo-days-extension-announcement) even more high profile in 2025. **Categories:** All articles, Amazon Web Services (AWS), CKAN, Drupal, Kate Sampher, Open Data, Thought Leadership **Tags:** CKAN, open data, Thought Leadership --- ### [Link Digital releases final in a series of CKAN instructional videos](https://linkdigital.com.au/news/2024/03/link-digital-releases-final-in-a-series-of-ckan-instructional-videos/) **Published:** March 31, 2024 **Author:** Andrew Nette **Content:** A further eight videos have been uploaded, all out together by one of [Link Digital’s](https://linkdigital.com.au/) global team of CKAN experts, Sergey Motornyuk. These new videos add to the ten already posted on our YouTube Channel. They showcase the abilities of CKAN and how its functionality as open source software can be maximised through the deployment of a variety of extensions and plugins. [Along with the CKAN installation and walk-through videos already posted on our YouTube channel by another one of our CKAN developers, Brett Jones](https://www.youtube.com/playlist?list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx), we believe these represent one of the most comprehensive and detailed collections of CKAN instructional videos available on the Internet. As a [CKAN ‘co-steward’](https://linkdigital.com.au/news/2019/08/co-stewarding-of-the-ckan-project-is-about-delivering-results-rewards-and-recognition/) and one of its largest contributing developers, [Link Digital](https://linkdigital.com.au/) is keen to assist CKAN’s users and contributors to get the most from these. The latest videos cover the following topics: [**HTML and cascading style sheets (CSS) in CKAN installation:**](https://www.youtube.com/watch?v=p_IbWkEqS2A) the crucial role of HTML and CSS in CKAN installations and particularly the function of CSS, a key component of the World Wide Web, for specifying the presentation and styling of web pages written in markup language such as HTML. [**The new CKAN plugin and Blueprint:**](https://www.youtube.com/watch?v=-X4begR5OXE) extending CKAN’s functionality using Python programming and CKAN’s existing plugin architecture. [**Custom dataset fields:**](https://www.youtube.com/watch?v=rhL17DBufAU) an examination of customised dataset fields and how they interact with organisational structures in data management. [**CKAN application programming interface (API):** ](https://www.youtube.com/watch?v=C1DiQJVMbno)a look at the key aspects of utilising the CKAN API to create datasets and make POST requests (one of the main Hypertext Transfer Protocols (HTTP) methods used in web development and API communication). [**Code structure and auth validation:**](https://www.youtube.com/watch?v=fwDymUxiAhI) the basics of writing and structuring code correctly, including the importance of leveraging validators to write well-structured and easily testable code. [**Creating new tables in a database:**](https://www.youtube.com/watch?v=Mfs3--iPlIQ) including defining models, generating columns, and establishing relationships between tables. [**An exploration of Facets:**](https://www.youtube.com/watch?v=ntCwAekIaeM) a powerful search tool for [Elasticsearch](https://www.elastic.co/), an open-source search and analytics engine that allows users to extract statistical information from search results. [**Datastore, scheming and spatial:**](https://www.youtube.com/watch?v=dSa2ia-70oY) how to Utilise schemas – the organization or structure for a database – to improve your data management. The videos are in Russian language but non-Russian speakers are able to listen to them by [utilising the Chrome Browser plugin called Language Reactor, available here](https://chrome.google.com/webstore/detail/language-reactor/hoombieeljmmljlkjmnheibnpciblicm). - Click on the ‘Add to Chrome’ button, - Then click on the ‘Add Extension’ button in the pop-up window. The plugin will then be added to the Chrome browser extensions and made available (and running) when viewing Sergey’s videos on YouTube. Other languages, apart from English, are also available. If you have found this post useful, you might be interested in taking part in a series of forums being held by [Link Digital](https://linkdigital.com.au/) on the last Thursday of every month, Australian EDT. These forums will connect you with like-minded experts who are passionate about the importance of open data and want to stay updated on the latest developments in the field. They are free to attend and open to everyone. [Register today](https://linkdigital.com.au/public-forum/?utm_source=google&utm_medium=blog&utm_campaign=public+forum). **Categories:** All articles, CKAN, Tutorial **Tags:** CKAN --- ### [Create a new CKAN Development Environment and install a new extension](https://linkdigital.com.au/news/2024/05/create-a-new-ckan-development-environment-and-install-a-new-extension/) **Published:** May 14, 2024 **Author:** Brett Jones **Excerpt:** Here is how to set up a new CKAN development environment conveniently using Docker and a tutorial on installing a new CKAN extension. Let's get started. **Content:** Setting up a new CKAN development environment using Docker is a convenient way to quickly get started with CKAN development without worrying about the intricacies of dependency management and environment setup. Docker containers provide a consistent and easily managed environment across different machines. In this exercise, we will create a new CKAN extension called “ckanext-pigeon” We first need to download the **ckan-docker** repository: **git clone** [**https://github.com/ckan/ckan-docker**](https://github.com/ckan/ckan-docker) This will create a directory called **ckan-docker**. We will rename that directory to **ckan-docker-pigeon** We then need to create the Docker Compose environment file called **.env** For convenience we copy the example **.env** file as follows: **cd ckan-docker-pigeon/** **cp .env.example .env**. Within the **.env** file we set the **CKAN\_SITE\_URL** parameter to be **http://localhost:5000** The CKAN Development environment uses a development version of the Docker Compose file **(docker-compose.dev.yml)**and the Dockerfile **(Dockerfile.dev)** Next we build the local images and then run containers off these images as follows: **docker compose -f docker-compose.dev.yml build** **docker compose -f docker-compose.yml up** (ie: run containers) We then bring up a VS Code Development IDE by running the following command **code .** We have a screen that looks like the following: ![](https://lh7-us.googleusercontent.com/W4WVlvcXH5dSDFQmRT82K8_rQkdkZC80_pdHfE62lGxuybhkcYzSaI1lTzkAc5KO4FOg1m2Bq2nzJkS682UTobRdseOF7p6fxHRCGO1z-Gw_CnLYLBhpvx7W3A4PC4fmrM1GOoXyZKLecYUQK7oB2Kc) From the host machine we then need to generate a CKAN extension template into a specific directory located within the running CKAN container using the following script **docker compose -f docker-compose.dev.yml exec ckan-dev ckan generate extension -o /srv/app/src\_extensions** ![](https://lh7-us.googleusercontent.com/egm69d0HH23D7Falvu8JrM6dXropvoCtL17ma8dtVl5_HjLYfO5ekrzomIqFj8oKC--gwwVd-RAXSyoVhetnrRWeiHlq7IiSaMTHcsmkKBRmwvzQm1idHAUiY5KI8xneBem5eUuhVCos5kZc0MbOLkE) Now we can get a shell on the running CKAN dev container and change directory into the src\_extensions. We see the **ckanext-pigeon** extension has been created **cd /srv/app/src\_extensions; ls** ![](https://lh7-us.googleusercontent.com/mvkyXl4fJUq4-4aZuXRYMUyPBGR2Kq5cBpQtwJHdDXo2oZ9ZQBKR0NfL_VESmWxmNYxlKqUc8MbGs2XGK1v7k9ySXdjp9-V9mVM8inWOmxSrdm3cGDnLvTD_IHDLs3wtVDqIRVzRep0A3qkd9iHvIW4) In the Docker Compose file we have a Docker volume configured that allows us to map a local directory to a (remote) directory within the running CKAN container ie: **src/ (local) → /srv/app/src\_extension/ (remote)** ![](https://lh7-us.googleusercontent.com/vZFa1ZajzPu4oBnOJAjyzzNZSZLNpZa2fMmaBy3okyhdf2M3nRGjKCS9Z4Q2DiZWilAdmJOSSatHOvWAl_Q13fo6WpLpRFZFEO_RRITjgxrWmkYvv5_iL8QDK34bk-zeac7w-JO6Gpq4TpSHPnaj_-4) This type of volume mapping in Docker is called a **bind mount** and is a way to link a directory or file on the host machine to a directory within a Docker container. It allows you to share files and directories between the host and the container, making it useful for development, debugging, and sharing data between the two environments. We now have a way to run up a local Development environment where changes are reflected immediately in the running CKAN Docker container. Next, we need to update the **.env** file to add the pigeon extension to the end of the environment variable: **CKAN\_\_\_PLUGINS** ![](https://lh7-us.googleusercontent.com/KOc3v_4iQKBTLxCnwq5Tq0FSsjRfUUvEjhRT2rZzcSlE9opW1_dHhnTaMGfsj0HAdP-3KviRCgwCTpkpctNmu4pOBZaUGUJUsXR_3WfKzNlvXOAhiccoI5ahH7ElpCec--EbziBm98Jn5-d0rrQdY1Y) We stop the stop and start all containers **docker compose -f docker-compose.dev.yml stop** **docker compose -f docker-compose.yml start** The new Pigeon CKAN extension (ckanext-pigeon) is now activated. It’s not “doing” anything but it is running as an extension within the CKAN container. We can run **http://localhost:5000/api/action/status\_show** to show the status of the CKAN application running within the CKAN container. It displays what plugins are installed. ![](https://lh7-us.googleusercontent.com/iS3sNzqlE-1nlPHrazwRud61gnYW-noWIHYtp9b7mwDvOzgmRnwwf6fxqXowbHx5BkwO7HzpVxPAOIzixpgDTVVzmeaL8ByyOYNWCFBniuel_r81N9cLxB3vXvQjUJNXoGMCyvRPqm4Z7MozrQ67Taw) And that’s it! --- **Related video:** CKAN Extensions | Install into a new CKAN docker development environment [This video](https://www.youtube.com/watch?v=0TDXofa4knU&list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx) provides a step-by-step walkthrough for installing a CKAN docker development environment and seamlessly generating a new CKAN extension. Here’s a re If you would like to learn more about CKAN and how you can establish developer operations to support your data portal projects please [get in touch](https://linkdigital.com.au/get-in-touch/). **Categories:** All articles, CKAN, Resources, Tutorial **Tags:** CKAN --- ### [Link Digital’s Secure Data Exchange](https://linkdigital.com.au/news/2024/06/introducing-link-digitals-secure-data-exchange/) **Published:** June 24, 2024 **Author:** Andrew Nette **Excerpt:** SDE is a powerful, flexible, and easy to use approach for data custodians to manage the complete lifecycle of their data across multiple departments, organisational branches, and internal and external users, in a controlled access environment. **Content:** Link Digital’s [Secure Data Exchange (SDE)](https://linkdigital.com.au/secure-data-exchange/) is a new approach to helping organisations exchange data in a completely secure domain. While primarily aimed at government departments and related entities, SDE can be utilised by data custodians in other large, complex organisations, including not-for-profits and corporates, who are seeking to securely share data across their domain. ## **What problem is SDE designed to address?** Governments at all levels are collecting and using data more than ever to increase transparency and inform policy development and service provision. But as the amount of data increases, so too do the challenges of effectively managing and sharing data across its life cycle. The sheer mass of data can leave governments with little better than a veritable data swamp, from which it is impossible to derive any real insights or benefit. This situation also makes it difficult and time consuming for staff to find the right data for their project or research, ascertain its quality, and identify its custodian. There are also major issues related to sharing data effectively and securely. For example, the data may include private information that once shared can easily find their way into the public realm, with major reputational and legal ramifications. SDE is a powerful, flexible, and easy to use approach for data custodians to manage the complete lifecycle of their data across multiple departments, organisational branches, and internal and external users, in a controlled access environment. Link Digital has already delivered the SDE capability to a government client in Australia, resulting in increased security, efficiency and collaboration. ![](https://linkdigital.com.au/wp-content/uploads/2024/08/img-Link-Digital-Secure-Data-Exchange-Access-Flow-1024x892.png)Secure Data Exchange Access Flow—Link Digital ## **What SDE can offer** SDE is not the solution to all the problems facing data custodians in government and other large organisations. Rather, it is an approach that utilises open sources technology, such as [CKAN, the Comprehensive Knowledge Archive Network](https://www.ckan.org/), and [Drupal](https://www.drupal.org/), a content management system used to build and manage websites, to assist large organisations to develop the innovative solutions they require to simplify complex data sharing and delivery across their operations. SDE makes it easier and more efficient to reuse, evaluate and securely share internal data in one core data platform. It provides an intuitive and simple to use workflow to manage data requests, negotiate and generate data sharing agreements, grant and revoke data access, and discern patterns of data usage over time and across different levels of operations and functionality. And because SDE is open source, there are no licensing fees, making it not only an accessible but a cost-effective solution. ## **SDE has the following functionalities:** ### *Structured data sharing while keeping flexibility and control* SDE allows government departments and other large organisations to retain control of their important data while reaping the benefits of collaboration that can come from its sharing. It does this by assisting data custodians to: - Create and oversee a highly customisable workflow to manage the complex movement of data across multiple departments, organisational areas, projects, and data users. - Control who can access their data, and the conditions under which this occurs. ### *Improved visibility in terms of who is using your data* SDE provides a streamlined, easy-to-use and interpret dashboard where data custodians can view all data requests, their status (pending, final approval, ended), and all data sharing agreements. This includes the ability to revoke approval to use data. ### *Improved metadata* A customised metadata scheme is incorporated into the workflow of the SDE system. This complies with the criteria set out in the latest [Data Catalog Vocabulary standards](https://www.w3.org/TR/vocab-dcat-3/#:~:text=DCAT%20enables%20a%20publisher%20to,of%20datasets%20and%20data%20services.), designed to facilitate interoperability between data catalogs. ### *Improved trust and accountability* The creation of a streamlined approval procedure improves transparency in the use of data and helps foster a culture of trust and mutual accountability around data sharing within organisations. Central to this is a highly functional internal workflow process that enables the creation of data sharing agreements. A requester wanting to access data will need to apply for approval from its custodian. SDE enables the two parties to negotiate the conditions for data sharing. Once complete, this will result in an automatically generated downloadable PDF agreement, that can include: - What data can be accessed. - Who can access and use the data. - The purpose for which the data can be used. - The time period for which the data can be used. - The conditions under which data access can be revoked. ### *One point of access and one point of truth* SDE allows data custodians to see all their data in one place. This ensures that there is one source of truth for the custodian’s data sets and prevents aged or incorrect data from being shared. Link Digital can integrate SDE into a data lake, data stores, etc, so that the data sharing agreement is always pointing to the most up-to-date data in core systems. These operations all sit behind corporate Identity Access and Management systems, allowing confidence when users are updated on the core security platform. ## **Conclusion** While transparency continues to be vital to government data agendas, there is an increasing focus on data management; how the considerable and growing amount of data being held can be better stored and catalogued, and how it can be made more discoverable and shareable—to improve service provision and policy development. SDE offers government and other large organisations the approach and tools to develop innovative, cost-effective solutions to the challenges of better managing and sharing their data. ## Get in touch We, at [Link Digital](https://linkdigital.com.au/about-us/), work with governments, NGOs, research, and academic institutions worldwide to help them create meaningful change with data, and SDE is one of the many approaches we can employ. If you are interested in hearing more, [t](https://linkdigital.com.au/get-in-touch/)[ell us about your project](https://linkdigital.com.au/get-in-touch/), and one of our data experts will be in touch. **Categories:** All articles, CKAN, Drupal, Government **Tags:** CKAN, Data Custodians, data sharing, Link Digital, Secure Data Exchange --- ### [How to categorise CKAN Actions and Authorisation](https://linkdigital.com.au/news/2024/06/ckan-actions-and-authorisation/) **Published:** June 25, 2024 **Author:** Brett Jones **Excerpt:** Actions are essentially the API endpoints or operations that can be performed within the CKAN system. Actions can be categorised into several groups. Read more. **Content:** ## **Actions in CKAN** Actions are essentially the API endpoints or operations that can be performed within the CKAN system. These actions are exposed through the CKAN Action API, allowing users and applications to interact with the CKAN instance programmatically. Actions can be categorised into several groups: 1. **Dataset Actions**: Operations related to datasets, such as creating, updating, deleting, and searching datasets. 2. **Resource Actions**: Operations related to resources (the actual data files), such as creating, updating, and deleting resources associated with datasets. 3. **Group and Organization Actions**: Operations to manage groups and organisations within CKAN. 4. **User Actions**: Operations to manage users, such as creating users, updating user information, and managing user permissions. 5. **System Actions**: Operations for system-wide configurations and maintenance tasks. Each action is usually named following a convention, such as **group\_create, package\_create, package\_update, user\_create, organization\_list**, etc. ## **Authorisation in CKAN** Authorisations in CKAN determine whether a user has permission to perform a specific action. The authorisation system in CKAN is highly customisable and allows for fine-grained control over what actions a user can perform. Key concepts in CKAN’s authorisation system include: 1. **Roles**: CKAN defines several default roles, such as **admin, editor, member**, and **reader**, each with varying levels of permissions. - **Admin**: Has full control over the organisation or dataset. - **Editor**: Can create and edit datasets and resources. - **Member**: Can view private datasets within the organisation. 2. **Permissions**: These are the specific rights granted - **System Level**: Permissions that apply to the entire CKAN instance. - **Organisation Level**: Permissions that apply within a specific organisation. - **Dataset Level**: Permissions specific to individual datasets. 3. **Authorisation Checks**: When a user attempts to perform an action - Checking the user’s role and the permissions associated with that role. - Evaluating custom authorisation functions or rules, if configured. 4. **Authorisation Functions**: CKAN allows the implementation of custom authorisation logic through authorisation functions, which can be defined in CKAN extensions. These functions can be used to implement complex authorisation rules that go beyond the default role-based permissions. ### **Example Scenario #1 – Create a Package** Consider an example where a user wants to create a new dataset. The following steps outline the action and authorisation process: 1. **Action Invocation**: The user calls the **package\_create** action through the CKAN API or web interface. 2. **Authorization Check**: CKAN checks if the user has the **create package** permission. - If the user is an **admin** or **editor** in the relevant organisation, they typically have this permission. - If custom authorisation functions are defined, CKAN evaluates these to decide. 3. **Action Execution**: If the user is authorised, the **package\_create** action is executed, and the dataset is created. If not, an authorisation error is returned. By managing actions and authorisations, CKAN ensures secure and organised access to data and resources, enabling effective data management and collaboration. ### **Example Scenario #2 – Create a new Group** Consider an example where a user wants to create a new group. The following steps outline the action and authorisation process: 1. **Action Invocation:** The user calls the group\_list action through the CKAN API or web interface. 2. **Authorization Check:** CKAN checks if the user has the list group permission. - If the user is an admin or editor in the relevant organisation, they typically have this permission. - If custom authorisation functions are defined, CKAN evaluates these to decide. 3. **Action Execution:** If the user is authorised, the group\_list action is executed, and the list of datasets in the group is returned. If not, an authorisation error is returned. That’s it! You can also watch[ the 16-minute video](https://www.youtube.com/watch?v=hwhymCZv57o&list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx&index=5&t=725s&pp=gAQBiAQB) on [Link Digital YouTube Channel](https://www.youtube.com/@link-digital) *In case you missed the previous tutorials, go to the main [article to explore more topics](https://linkdigital.com.au/news/2024/04/welcome-to-tuesday-tutorial-articles-to-help-you-get-the-most-out-of-ckan/).* --- *The world of open data and data management is constantly evolving. Link Digital provides insights to help you stay updated. **[Subscribe to our newsletter.](https://linkdigital.com.au/newsletter)*** **Categories:** All articles, CKAN, Resources, Tutorial **Tags:** CKAN --- ### [Why open source technology is the best fit for government data management](https://linkdigital.com.au/news/2024/07/why-open-source-technology-is-the-best-fit-for-government-data-management/) **Published:** July 10, 2024 **Author:** Andrew Nette **Excerpt:** This post will look at the data management challenges facing governments and the key reasons why open source technology is best placed to meet them. **Content:** Governments at all levels are increasingly adopting open source software as a solution to their data management challenges. The following post will look at the data management challenges facing governments and explore the key reasons why open source technology is best placed to meet them. ## **The challenges for government from increased data** Much has been made of how changes in the data and digital space have transformed the business of government. The increasing collection of data and its use in better informing policy development and service provision, as well as growing expectation on the part of many citizens to access services digitally, all pre-date the COVID 19 pandemic. But the pandemic and the global response to it turbo charged the pace of both the digitisation of government services and their collection and use of data. And as the amount of data governments collect has increased, so too have the challenges of effectively managing it across its life cycle. The sheer mass of data now available to governments can make it complex and time consuming for public servants to find the right data for their project or research, ascertain its quality, and identify its custodian. There is also a plethora of risks for governments related to sharing data effectively and securely. Governments are increasingly pursuing two interconnected agendas in the data and digital space: making data open in the interests of promoting transparency and a more informed public, while assisting data custodians to more efficiently and securely store, catalogue and share data internally. The main response to the first challenge has been the uptake of open data portals; front-line interfaces that bridge data providers and users, helping to ensure that data is not just accessible but usable. The second challenge has seen the adoption of internal data management platforms designed to efficiently and securely gather and store an organisation’s data assets in one central on-line location. Through a web interface, it can then enable these assets to be managed and shared, with both internal users and external collaborators and agencies, in a highly controlled environment. ## **The growing role of open source technology** Open source technology – software for which the underlying code and features are publicly available and free to use, including modifying and distributing it – has been central in the uptake of open data portals and internal data management platforms. Open source contrasts with proprietary software, the source code for which is private, a license for which must be purchased, and that can only be modified by its author, most often a private company. CKAN, [the Comprehensive Knowledge Archive Network](https://linkdigital.com.au/news/2024/04/welcome-to-tuesday-tutorial-articles-to-help-you-get-the-most-out-of-ckan/ "Welcome to Tuesday Tutorial: Articles to help you get the most out of CKAN"), is a key open source software increasingly used by governments to power external and internal data management. CKAN can be configured and set up to function as an open data platform or internal data management system once it is deployed and hosted on a web server and is widely adopted by governments across the world, including [data.gov, the United States open data portal](https://data.gov/ "data.gov, the United States open data portal"), and the open data portals of [the Canadian Government](https://www.canada.ca/en.html "European Union") and the [European Union](https://data.europa.eu/en "European Union"). Another important piece of open source software is Drupal, an open source content management system used to build websites and author content, which has a growing number of global users. While the adoption of open source software by governments dates to the early 2000s, it was given a major boost during the presidency of Barack Obama, when the [Whitehouse website](https://www.whitehouse.gov/ "Whitehouse website") used Drupal and released its code, a development that played a major role in mainstreaming the transformation of government as a user of open source technology. European Union member states at the national, state and local level have also spearheaded the uptake of open source software over the last decade. ## **The benefits of open source** For over a decade [Link Digital](https://linkdigital.com.au/ "Link Digital") has positioned itself as a supplier of open source data and digital services, with a particular focus on using CKAN to enable governments to improve their external and internal data management capabilities. And we believe open source technology is particularly suited to the complex and growing challenges facing the public sector at all levels. Here are our six essential takeaways for why this technology is superior to proprietorial solutions in data management for governments. ***No Vendor lock in*** At its most basic level proprietary software solutions lead to vendor lock-in. This is when users become dependent on a specific vendor for updates, support and maintenance, and compatibility with other software and, and cannot easily switch to another vendor. This makes it challenging for users to customise or switch to an alternative solution without incurring major costs. Open source solutions such as CKAN eliminate this risk because users have the complete freedom to modify, upgrade or tailor solutions without incurring substantial financial outlays. ***Lower cost*** Open source software is not just cheaper than proprietary software because it is free to use and eliminates the need to pay licencing fees. It offers additional cost saving through its greater interoperability, easier integration and customisation, and reduced barriers to reuse. The lower cost can make it particularly suitable for governments operating with limited resources. This is not to say that open source solutions such as CKAN come with no cost. As the American think tank [New America put it in a 2020 report](https://www.newamerica.org/digital-impact-governance-initiative/reports/building-and-reusing-open-source-tools-government/ "New America put it in a 2020 report"), ‘There are other types of cost considerations to make, such as server infrastructure or technical talent to modify the source code and paid support options. Still, these costs are often much less than the typical license fees associated with proprietary software. In addition, most of these costs are a constant regardless of whether you are using open source tools, building your own software, or using proprietary solutions.’ ***Easier customisation and greater flexibility*** Data management platforms powered by proprietary software are closed systems, and users are dependent on the provider for the tools necessary to customise their system. This can make it a complex, time consuming and expensive process to modify proprietary software to suit a government department’s needs or integrate applications seamlessly with their existing data systems Tools such as CKAN and Drupal can be deployed to help engineer a completely new data management solution or to migrate data from an existing legacy system based on proprietary software to open source. CKAN can also be updated and customised to meet a user’s unique and changing data needs, including scaling operations up, or aligning with the needs of changing government laws and regulations, without waiting for the vendor updates or action. [This is due to a wide variety of extensions that can greatly increase CKAN’s basic functionality](https://extensions.ckan.org/ "This is due to a wide variety of extensions that can greatly increase CKAN’s basic functionality"). ***Increased control*** Government data management platforms based on open source software allow data custodians to more easily see what data is being stored in their system and manage the lifecycle of their data assets across multiple departments, organisational branches, and internal and external data users, in a highly secure, controlled access environment. Not hosting important data assets on a proprietary vendor’s service gives the user greater data sovereignty, as well as the ability to set their preferred standards of security and keep complete control of their data and metadata. ***Security and support*** Open source software can be made highly secure. While the security of CKAN applications can be user hosted, security updates and best practices are driven by the CKAN community. In addition to a core development team that contributes to keeping the CKAN software in good shape, it is supported by a large and expanding user base. This means CKAN is on a continuous improvement journey, with each successive version of the software looking at improving its efficiency, performance, stability, interaction, and usability. This community also provides support, advice and resources to in-house developers, and oversees the regular release of security patches and updates to address vulnerabilities and improve overall security. Closed source code lacks this third party review by a large group of people who constantly eyeball the code for vulnerabilities. This can allow vulnerabilities to exist and remain undiagnosed and dealt with. The security of data management platforms powered by CKAN can be further enhanced by proper configuration and adherence to best practice security protocols and access controls within the host organisation, as well as by engaging a third-party service provider, such as Link Digital. ***Innovation*** Link Digital believes open source technologies are particularly suited to the data management needs of governments. The open nature of the software means it is more publicly accessible, which can enhance trust in government operations. Its flexibility and easy to customise features encourage innovative thinking. It also offers the potential to leverage collaboration between government and the broader digital ecosystem, for example, between public servants and the open source community around CKAN. This can not only expose governments to a wider base of IT talent, but to new skills and ways of working, with flow on impacts in terms of improved data management and data informed decision making skills for the public service. —- **Get in touch** Link Digital has over a decade of experience providing organisations with customised internal data management solutions powered by CKAN. We can tailor an innovative, cost-effective solution to the internal challenges of better managing and sharing your data. If you are interested in hearing more, [please get in contact and tell us about your project](https://linkdigital.com.au/get-in-touch/ "please get in contact and tell us about your project"), and one of our data experts will be in touch. **Categories:** All articles, CKAN, Drupal, Government **Tags:** CKAN, Drupal, government data management, internal data management, open data portal, open source --- ### [The challenge of internal data management: How CKAN can help](https://linkdigital.com.au/news/2024/07/the-challenge-of-internal-data-management-how-ckan-can-help/) **Published:** July 22, 2024 **Author:** Andrew Nette **Excerpt:** Government departments, corporations, universities and large not-for-profits can use internal data management platforms to solve the challenges arising from the expanding mass of data they collect. Find out mo **Content:** - [Introduction](#aioseo-introduction) - [Features](#aioseo-features) - [Benefits](#aioseo-benefits) - [Security](#aioseo-security) - [Are you ready to transform your internal data management?](#aioseo-are-you-ready-to-transform-your-internal-data-management) ## Introduction In addition to powering open data portals, the open source software known as CKAN—[the Comprehensive Knowledge Archive Network](https://ckan.org/ "the Comprehensive Knowledge Archive Network")—is playing an increasing role in helping organisations with their internal data management. It is doing this principally through powering what are known as internal data management platforms. The following article will briefly examine this and how your organisation can maximise the benefits of CKAN to meet your internal data management needs. An internal data management platform efficiently and securely gathers and stores the data assets an organisation has at its disposal in one central online location. It then enables these to be catalogued and managed over their life cycle, including sharing them with internal users and external collaborators and agencies within a highly controlled and secure environment. Government departments, corporations, universities, and large not-for-profits can use internal data management platforms to solve the challenges arising from the expanding mass of data they collect: how to extract knowledge and benefit from this data to help inform business decisions and drive research or more evidence-informed policy-making and to share it effectively and securely, internally and externally. ## **Features** A CKAN-based internal data management platform offers the following: - Superior search functionality due to the use of advanced descriptive [metadata and cataloguing](https://linkdigital.com.au/news/2024/08/how-ckan-and-fair-principles-can-enhance-metadata-management/#:~:text=The%20importance%20of%20metadata%20management) features to organise and classify data assets. - Ability to monitor data usage and metrics through the creation of real-time reports and dashboards. - Secure data sharing by configuring permission settings to control critical and sensitive internal data at the group or individual level. - Easy migration of data between existing internal data portals and systems. - Flexibility to scale up or extend functionality to meet the evolving needs of your organisation. - A wide variety of extensions allows for easy customisation that can vastly increase CKAN’s out-of-the-box functionality. - Better visualisation and comprehension by enabling data to be presented using charts, graphs, infographics, videos, and maps. [![Publish your data easily with CKAN](https://linkdigital.com.au/wp-content/uploads/2024/10/final-img-publish-your-data-easily-with-CKAN-1024x535.jpg)](https://linkdigital.com.au/ckan-and-open-data/) ## **Benefits** In addition to being a powerful, flexible, and secure approach to managing and sharing the complex movement of data across different parts of your organisation and with external collaborators, a CKAN-based internal data management system can offer the following benefits: - No vendor lock-in, and users have the freedom to modify, upgrade, or tailor solutions without incurring substantial financial outlays. - Substantial cost savings due to the absence of licensing fees, the software’s interoperability, easier integration and customisation, and reduced barriers to reuse. - More efficient and streamlined approval procedures for data sharing can improve transparency and enable data custodians to discern and report on data usage patterns across your organisation and over time. ## Security Open source software like CKAN can be made highly secure. In addition to a core development team that works to ensure the software is continuously improved, CKAN is supported by a large and expanding user base. These users provide support, advice, and resources to in-house developers and oversee the regular release of security patches and updates to address vulnerabilities and improve overall security. The security of a CKAN internal data management platform can be further enhanced by engaging a third-party service provider, such as Link Digital and the adoption of effective data governance and other best practices within the host organisation. ## **Are you ready to transform your internal data management?** Link Digital has extensive experience providing customised CKAN-powered internal data management platforms. If you want to know more, [download the ebook about internal data management with CKAN](https://linkdigital.com.au/services/internal-data-management-with-ckan/ "download our new ebook about internal data management with CKAN"). Then[ get in contact and tell us about your project](https://linkdigital.com.au/get-in-touch/ "download our new ebook about internal data management with CKAN"), and one of our data experts will be in touch. **Categories:** All articles, CKAN, Drupal, Government, Higher Education/Research, Internal data hub, Open Data, Technology Infrastructure **Tags:** CKAN, data security, data sharing, Gov data, government data management, internal data management, open data --- ### [Link Digital to establish beneficiary fund for digital public goods](https://linkdigital.com.au/news/2024/07/link-digital-to-establish-beneficiary-fund-for-digital-public-goods/) **Published:** July 30, 2024 **Author:** Andrew Nette **Excerpt:** Link Digital has made some exciting announcements about its future direction, including establishing a beneficiary fund for digital public goods. Read More. **Content:** The open source data management software known as CKAN – [the Comprehensive Knowledge Archive Network](https://ckan.org/) – and the community around are always evolving. As an Australian private company that has built a global reputation as a CKAN expert [and one of the software’s ‘co-stewards’](https://linkdigital.com.au/news/2019/08/co-stewarding-of-the-ckan-project-is-about-delivering-results-rewards-and-recognition/), [Link Digital](https://linkdigital.com.au/) has always strived to move in tandem with these changes. And in response to recent CKAN-related developments we have made some exciting announcements about our future direction. This post will recap these and explore the important context within which they are happening. ## **CKAN origins and development** CKAN was developed by the [Open Knowledge Foundation](https://okfn.org/en/) in 2006, with the guiding principle that open data is a public good that should be non-right restricted and easily transferable, and that creates more value the more it is shared. It was enabled largely by the then new package capabilities of Debian Linux; tools that assisted with the automation and installing and upgrading computer programs, and which made it easier for software developers to re-use and build upon each other’s work. In the broader context, CKAN was also part of what is known as the [Third Wave of Open Data](https://opendatapolicylab.org/third-wave-of-open-data/). The Third Wave was based on the proposition that the open data ecosystem has moved beyond simplifying data and its economic and social impacts; to how governments, private corporations and civil society organisations can better manage and understand the data they have and share it to provide improved products and services, and a more informed citizenry. ## **Supporting CKAN’s user base** CKAN became the basis of the United Kingdom’s open data portal, [data.gov.au](https://www.data.gov.uk/) in 2010, and it has since become central to the global expansion of open data initiatives. [Research last year identified nearly 400 regularly updated CKAN data portals in 59 countries](https://civicdataecosystem.org/2023/06/19/analysis.html). This includes portals with national and transnational significance, such as the [European Union’s open data portal](https://data.gov/) and [the United States open data portal, data.gov](https://data.gov/). But CKAN’s use by large actors can obscure a more nuanced picture. CKAN is what is known as out of the box software, i.e., it can work immediately when placed into service. CKAN can be set up and configured to function as an open or internal data platform once deployed and hosted on a web server. And because it is open source, the cost of accessing a CKAN instance is small compared to commercial software. This means that much of CKAN’s usage is by individuals or small groups with only limited developer experience and resources. While the CKAN software has a core development team that contributes to keep it in good shape, it is also supported by this much larger global user base. How to nurture and grow this base is the aim of an initiative called [Pathways to Enable Open-Source Ecosystems (POSE)](https://new.nsf.gov/funding/opportunities/pathways-enable-open-source-ecosystems-pose), supported by the [United State National Science Foundation](https://www.nsf.gov/) and based out of the University of Pittsburgh. POSE’s second stage, which was recently funded, seeks to strengthen the community around the software, including creating onboarding pathways for new people to contribute, improved documentation and governance, better tracking of CKAN adoption and help to get users up to speed with the latest version of the software. ## **The rise of ‘civic tech’ and the importance of digital public goods** CKAN now plays a vital role in what is known as civic tech. According to [a 2016 paper by CKAN founder Rufus Pollock](https://rufuspollock.com/open-source-software-and-government/), civic tech is ‘digital technology (websites, apps and platforms) related to “civic” life. As defined, it includes most notably all government IT (whether in house or procured) but also includes technology created by others directly for citizens – from apps that let you register to vote to those that let you email your elected representative.’ Governments, for example, are increasingly using CKAN to meet two interconnected agendas: open data portals to make data open to promote transparency; and internal data management platforms to assist data custodians to more efficiently and securely store, catalogue and share their organisations data assets internally. In recognition of the real world benefits of civic tech as a form of digital public infrastructure, CKAN has been awarded the status of being a [Digital Public Good](https://digitalpublicgoods.net/) (DPG) by the [Digital Public Goods Alliance](https://digitalpublicgoods.net/). This was a recognition of CKAN’s value as a driver of positive change in helping to attain many of the Sustainable Development Goals put forward by [United Nations (UN)](https://www.un.org/en/), and its use by governments and multilateral organisations like the [UN Refugee Agency](https://www.unhcr.org/) and the [United Nations Office for the Coordination of Humanitarian Affairs](https://www.unocha.org/), as well as philanthropic organisations and by grassroots civil society movements. ## **Improving CKAN’s core functions** All the developments mentioned so far, including the growth of CKAN and its community, and the software’s increasingly important role in civic tech, have informed two recent announcements by Link Digital First, in May [Link Digital announced a substantial investment to fund several new roles targeted at enhancing CKAN’s core capabilities](https://linkdigital.com.au/news/2024/05/link-digitals-major-initiative-to-boost-ckan-development/). These new roles, in addition to our current support for the software, focus on: - Support for CKAN to improve interoperability with [Data Catalog Vocabulary (DCAT) 3](https://www.w3.org/TR/vocab-dcat-3/), the global standard for making data catalogs interoperable. - Providing a better user experience. - Enhanced file management. These capabilities also align with improvements as part of the release of the next version of CKAN, known as v3.0, and are very much aimed at helping smaller and less resourced users to get more out of CKAN’s out of the box experience. They include: - Better user interface. - Modernising CKAN’s tech stack with [HTMX technology](https://htmx.org/). - The addition of [Elastic Search](https://www.elastic.co/), an additional technology that can be used to improve search ability. ## **Funding digital public goods into the future** Second, are ambitious changes to Link Digital’s operations going forward. Announced by founder and Chairman, [Steven De Costa](https://www.linkedin.com/in/stevendecosta), [at our Monthly Forum in June](https://www.youtube.com/watch?v=OX5QCENTkBQ&t=1584s), these include the transition to a different operating model and the establishment of a beneficiary fund that would sit above Link Digital’s commercial entity. This fund aims to supplement government funding for civic tech initiatives involving digital public goods, collaborative governance, and public code, globally. As to why now is the right time to announce these changes, De Costa stated: “Trust is always a barrier to partnerships and a company that operates singularly within a competitive market is, for better or worse, trusted only as far as a for-profit company should be. For-profit companies are very important within a commercial marketplace, especially one based on knowledge operations, yet they will remain constrained by their defensible value chain and unique offerings.” “Link Digital can stay competitive and profitable as a bespoke service provider servicing a small number of high value clients. We can also deliver entirely free and open value inputs for other organisations and individuals without any disadvantage to our commercial operations. But we need to compartmentalise, and we need the trust of the ecosystem we hope to collaborate with and support.” De Costa is under no illusions as to the future challenges that lie in store for this new direction. “Data is no small thing and no new thing, it is a large part of how we observe, model, plan and manage the things we collectively care about. Many voices will have an opinion on how to bridle this machine readable and machine trainable resource, for the betterment or worsening of every aspect of our lives.” “Link Digital is moving to a model where we will become an entirely positive influence on the entire open source community, and the very special open data and civic tech community that already has surrounded and drawn great benefits from the CKAN project. No doubt, others will pick a path too. I’m sure, and we will look forward to collaborating with those who choose to architect a future that builds for trust through openness and honesty.” We invite you to be a part of this journey—whether you’re a developer, policy maker, or passionate advocate for open data. Let’s collaborate to create a world where data is a tool for transparency, empowerment, and positive change. [Reach out today](https://linkdigital.com.au/get-in-touch/) and discover how you can contribute to building a better digital future. **Categories:** All articles, CKAN, Internal data hub, Open Data **Tags:** CKAN, CKAN community, digital public goods, Link Digital, open data --- ### [University of Manitoba’s ongoing contribution to the environmental data management ecosystem](https://linkdigital.com.au/news/2024/08/university-of-manitobas-ongoing-contribution-to-the-environmental-data-management-ecosystem/) **Published:** August 1, 2024 **Author:** Kate Sampher **Excerpt:** Link Digital congratulates the University of Manitoba, following the recent federal investment aimed at protecting Lake Winnipeg. This funding, which Environment and Climate Change Canada announced, emphasises the critical need for solutions to protect one of Canada's most important freshwater ecosystems. **Content:** Link Digital congratulates the University of Manitoba, following the recent federal investment aimed at protecting Lake Winnipeg. This funding, which [Environment and Climate Change Canada announced](https://www.canada.ca/en/environment-climate-change/news/2024/07/canada-invests-in-17-new-projects-to-help-protect-lake-winnipeg.html), emphasises the critical need for solutions to protect one of Canada’s most important freshwater ecosystems. The [Canadian Watershed Information Network (CanWIN)](https://canwin-datahub.ad.umanitoba.ca/), a project built by [Link Digital](http://linkdigital.com.au "Link Digital"), was one of the organisations that received funding from this program. This grant will significantly enhance efforts in managing and sharing environmental and climate data, contributing to the protection and sustainable management of the wider ecosystem. ## **Advanced data management solutions to support environmental research** At Link Digital, we are dedicated to supporting environmental research and stewardship through advanced data management solutions. Our collaboration with the [University of Manitoba, Clayton H. Riddell Faculty of Environment, Earth, and Resources](https://umanitoba.ca/environment-earth-resources/), a key participant in the newly funded projects, reflects our commitment to using open source technologies for environmental preservation. The University of Manitoba’s work, particularly in projects like CanWIN, is instrumental in providing data-driven insights into the health of Lake Winnipeg. ## **CanWIN and its data sharing capability** CanWIN serves as a comprehensive platform for managing and sharing watershed data, facilitating collaboration among researchers, policymakers, and the public. This platform is crucial for monitoring and analysing the factors impacting Lake Winnipeg’s ecosystem, thus providing a foundation for informed decision-making. CanWin uses CKAN – the [Comprehensive Knowledge Archive Network ](https://ckan.org/) – the world’s leading open source data management system. The standardised use of CKAN across our network partners ensures interoperability and ease of data sharing. ## **CanWIN’s involvement in the CKAN Community** A key individual in this partnership is [Claire Herbert](https://www.linkedin.com/in/claire-herbert-mb/), the Data Manager of [CanWIN](https://canwin-datahub.ad.umanitoba.ca/). Claire has been a very active and influential presence within the CKAN community, as well as within our broader community of Link Digital clients. She has made significant contributions by presenting at [a CKAN monthly live session in July 2022](https://www.youtube.com/watch?v=0CR85yByaGQ) and our public forum. Claire deeply engages in every opportunity to support others in their projects as well as to learn from the achievements of others in the community. Her active participation and insights have been invaluable in promoting best practices in data management and building collaborative work within the CKAN community. You can view one of Claire’s insightful presentations[ here](https://www.youtube.com/watch?v=dOSN2ibgdR0&t=266s). Her work continues to inspire and support data sharing initiatives that are crucial for projects like those aimed at protecting Lake Winnipeg. ## **More environmental conversation and data management solutions** The recent federal funding announcement aligns with our mission at [Link Digital, creating meaningful change with data](https://www.youtube.com/watch?v=OX5QCENTkBQ&t=774s). By enhancing the accessibility and utility of environmental data, we enable researchers and policymakers to address pressing environmental challenges effectively. Our work with CanWIN, [the Pacific Data Hub](https://linkdigital.com.au/project/pacific-data-hub/), and [Living Lakes Canada](https://linkdigital.com.au/project/columbia-basin-water-hub/) underscores the importance of integrated data solutions in environmental conservation. ## **Looking Forward** We are committed to continuing our support for these efforts through internal [data management solutions](https://linkdigital.com.au/news/2024/07/the-challenge-of-internal-data-management-how-ckan-can-help/) and our new [Secure Data Exchange](https://linkdigital.com.au/news/2024/06/introducing-link-digitals-secure-data-exchange/) feature, both of which use [CKAN](https://ckan.org/) and other open-source technologies. By partnering with leading institutions like the University of Manitoba, we aim to empower the environmental community with the tools they need to protect and preserve our natural resources. Let’s collaborate to create a world where research data is accessible to help guide efforts towards a cleaner and more sustainable water ecosystem. [Reach out today](https://linkdigital.com.au/get-in-touch/) and tell us how we can work together to build your data portal. **Categories:** All articles, CKAN, Environmental/Climate Change, Internal data hub, Kate Sampher, Open Data, Thought Leadership **Tags:** CanWIN, CKAN, open data, Thought Leadership --- ### [ISO19115 Geospatial Metadata Mapping and Validation with CKAN](https://linkdigital.com.au/news/2022/06/iso19115-geospatial-metadata-mapping-and-validation-with-ckan/) **Published:** August 14, 2024 **Author:** Steven De Costa **Excerpt:** Adoption of the latest metadata standards for describing geographic information ensures a higher level of interoperability between data portals, providing more value to end users by strengthening the whole ecosystem of geospatial data providers. **Content:** The schema required for describing geographic information and services by means of metadata, [ISO19115](https://www.iso.org/standard/53798.html), is maintained by the [International Standards Organisation](https://www.iso.org/). Within Australia and New Zealand this is approved with minor amendment by [Standards Australia](blank) and [Standards New Zealand](https://www.standards.govt.nz/). The current approved standard for AU and NZ is [AS/NZS ISO 19115.1:2015](https://www.anzlic.gov.au/resources/asnzs-iso-1911512015-metadata), which is recommended for use by [ANZLIC – the Spatial Information Council](https://www.anzlic.gov.au/), the peak intergovernmental organisation for the collection, management and use of spatial information in Australia and New Zealand. Link Digital’s early work with ISO19115 sought to capture and validate relevant metadata within a data portal for the [New South Wales Office for Environment and Heritage](https://www.environment.nsw.gov.au/). This work was conducted in 2015 and mapped only the most important fields against an earlier version of the ISO19115 standard, within a custom metadata extension for [CKAN](https://ckan.org/). The work was subsequently expanded and improved by mapping a more complete set of fields within the [ckanext-scheming extension](https://github.com/ckan/ckanext-scheming). In 2022, we completed the third iteration of our work with ISO19115 on two sites for the then NSW Department of Planning and Environment (now known as the [Department of Planning, Housing and Infrastructure](https://www.nsw.gov.au/departments-and-agencies/department-of-planning-housing-and-infrastructure) or DPIE): an internal data register (IAR), and the Government’s central resource for [Sharing and Enabling Environmental Data or SEED open data portal](https://www.seed.nsw.gov.au/). We worked with the NSW Government to ensure that the geospatial datasets in both the IAR and SEED were compliant with the changes in the standard prescribed in the latest ANZLIC endorsed version. This makes these datasets easier to find and use and makes the catalogues themselves interoperable to the level of current best practice. ## Link Digital creates its own validator tool One challenge we faced in the most recent effort was the lack of a validator that works with AS/NZS ISO 19115.1:2015. Link Digital solved this problem by creating our own validator tool, [very similar to this one](https://validator.schema.org/). The validator takes Extensible Markup Language (XML) – the markup language that provides rules to define any data – as an input and checks whether its adheres or not to the latest standard based on the most up-to-date guidelines for this standard. ## Ckanext-scheming extension This required us to infer requirements and implement a validator directly from the standard’s specification. We did this before implementing the schema to ensure that it would be compatible with the new standard. Complexity within the standard required a careful observance to conditional elements and nested structures. This task would have been very difficult without the use of the [ckanext-scheming extension](https://github.com/ckan/ckanext-scheming), which has strong support for nested structures. While it is not currently available as a stand-alone extension, it could in theory be reused on other internal and external portals that adopt the same standard. ## The value Adoption of the latest metadata standards for describing geographic information ensures a higher level of interoperability between data portals, providing more value to end users by strengthening the whole ecosystem of geospatial data providers. With the work to map the ANZLIC-endorsed version of ISO19115 for CKAN-based data portals completed, along with a complimentary validator in place, our clients can already register and validate geospatial datasets on three of the NSW Government portals we support. Those are the [Planning Data Portal](http://www.planningportal.nsw.gov.au/opendata/dataset), [SEED](https://www.seed.nsw.gov.au/) and an Internal Asset Register used by DPIE. This is great news for other agencies in Australia and New Zealand that wish to comply with AS/NZS ISO 19115.1:2015 within their own CKAN based data portals. Link Digital believes that the journey of a single aspect of a data catalogue’s maturity, is a good demonstration of the value we provide to our clients when employing our product development methodology over the long-term service life of a managed services agreement. ## **Get in touch** If you would like to learn more about CKAN and how you can comply with ISO19115 within your own data portal, please [get in touch](https://linkdigital.com.au/get-in-touch/). **Categories:** All articles, CKAN, DCAT (Data Catalog Vocabulary), Geospatial, Government, Higher Education/Research, Open Data, Steven De Costa, Thought Leadership **Tags:** CKAN, Geospatial Metadata Mapping, Thought Leadership --- ### [Using data to improve emergency response services](https://linkdigital.com.au/news/2022/09/using-data-to-improve-emergency-response-services/) **Published:** August 28, 2024 **Author:** Steven De Costa **Excerpt:** The SPOT App is an internal online web application designed to act as an aggregation point for automated data alerts. This information comes from the police and emergency service personnel, and can concern reports of fire and accidents, notices of official road closures, and whatever else is ‘emergent’ in the emergency response space in the Australian Capital Territory. **Content:** As the temperature rises, so does the fire risk for much of Australia. By being informed and prepared, we can help reduce the impact of fires on our communities, as well as prepare for and deal with other emergencies. The provision of emergency warnings and related information is an integral part of Australian state and territory emergency management arrangements. These warnings assist the public in making informed actions to safeguard life, property, and the environment. Emergency personnel can minimise their search time and maximise their recovery time when they have access to real-time information emphasising the areas most affected. The use of data analytics and intelligence is already important to saving lives and facilitating effective emergency management. With the availability and usage of smartphones and social media, disasters can be measured in real-time, allowing for a rapid and accurate response. ## State and territory emergency services, data and digital There is an enormous amount of literature on data’s growing role in emergency warning, management, preparedness, risk and reduction. This literature shows that while there may be considerable benefits to using data in emergency settings, the provision of data alone is not enough. Given the speed of events, what data is disseminated, as well as how and when, are vital. And, of course, it must be high quality data – accurate, relevant and trustworthy. Strengthened data analytics and intelligence, including data sharing that is fast, seamless, secure and reliable, is a key priority of state and territory governments across Australia. This includes Queensland’s [*Fire and Emergency Services Strategy 2030*](https://www.fire.qld.gov.au/sites/default/files/2021-03/QFES-Strategy-2030-Full.pdf), [Emergency Services Victoria’s ](https://www.emv.vic.gov.au/strategic-priorities/strategic-roadmap-2022-28/our-strategic-priorities/priority-two-strengthen-our-use-of-data-analytics-and-intelligence-to-improve-decision-making)[*Strategic Priorities, 2022-2028*](https://www.emv.vic.gov.au/strategic-priorities/strategic-roadmap-2022-28/our-strategic-priorities/priority-two-strengthen-our-use-of-data-analytics-and-intelligence-to-improve-decision-making) and the South Australia [*Government’s Emergency Management Data Strategy*](http://dpc.sa.gov.au/responsibilities/data-sharing/information-sharing-in-south-australia/south-australias-data-governance/Emergency-Management-Data-Strategy.pdf). New South Wales has [a Spatial Services’ Emergency Information Coordination Unit](https://www.spatial.nsw.gov.au/what_we_do/emergency_management) to ensure that best spatial and related data is provided to agencies dealing with natural and other disasters. Department of Natural Resources and Environment Tasmania has established an [Emergency Services GIS](https://nre.tas.gov.au/land-tasmania/location-data-products-and-services/emergency-services-gis) (Geographic Information Services) unit to provide ‘specialised spatial data and services for emergency services’ use in planning, preparedness, response and recovery activities after emergency incidents.’ These state and territory efforts are backed up at a national level by the Commonwealth’s [*National Emergency Management Agency Data Strategy 2023-25*](https://nema.gov.au/sites/default/files/inline-files/NEMA%20Data%20Strategy%202023-25.pdf), which focuses on real-time situational awareness to empower decision making, including effective financial support during and after an emergency. And the Commonwealth Scientific and Industrial Research Organisation has been undertaking research to help emergency workers and decision makers involving data visualisation, advanced data mapping, predictive analytics and mass data integration. ## **Single Point of Truth (SPOT) App** Link Digital’s contribution in this growing area has involved the development of Single Point of Truth (SPOT) App for the [Australian Capital Territory Emergency Services Agency (ESA)](https://esa.act.gov.au/new-website-agency). Link Digital had supported the SPOT App since its inception in 2018 and was excited to be selected as the preferred supplier when it came time to upgrade the App in 2022. [You can find out much more about the Single Point of Truth (SPOT) App on our site here.](https://linkdigital.com.au/project/the-act-esa-single-point-of-truth-spot-app/) The SPOT App is an internal online web application designed to act as an aggregation point for automated data alerts. This information comes from the police and emergency service personnel, and can concern reports of fire and accidents, notices of official road closures, and whatever else is ‘emergent’ in the emergency response space in the Australian Capital Territory. Public information officers from the ESA are then able to log into this as a ‘single point of truth’ and draw information from it to compose public alerts. These alerts are then pushed out as an official ‘notice’, to the ESA’s website and social media accounts, and through email and SMS, to the community, journalists, and other relevant government departments, etc, updating and informing them of emergency warnings in near real-time. During the 2019-2020 bushfires, the App was used regularly to inform the ACT community about official information on severe fire warnings, including evacuations. The App disseminated warnings with minimal delay, providing the ACT community with up-to-the-minute news updates. Before the SPOT App, the alerts, posts, emails and updates were manually sent out, delaying the time for important news to reach the community. Now, everyone receives the same information at once. ## **Have a similar project? Contact us** Is your organisation interested in utilising data in an emergency response settling efficiently and safely? [Contact us](https://linkdigital.com.au/get-in-touch/) and tell us about your project. **Categories:** All articles, CKAN, Environmental/Climate Change, Government, Open Data **Tags:** CKAN, climate data, open data --- ### [New CKAN Sync for Drupal module available to open source community](https://linkdigital.com.au/news/2024/04/link-digital-makes-new-ckan-sync-for-drupal-module-available-to-open-source-community/) **Published:** September 9, 2024 **Author:** Andrew Nette **Content:** ## Link Digital on CKAN and Drupal Link Digital is a CKAN co-steward and has been an active participant in the CKAN community since the software was launched in 2006. The company have also been very active in the Drupal space since the early 2000s. And [as this talk by our Chair Steven De Costa makes clear](https://www.youtube.com/watch?v=j-jofZONJuQ), we have been working on projects that include the integration of CKAN and Drupal – architecting a seamless user experience between the two as possible – for our clients since at least 2016. Now, Link Digital has published a [CKAN Sync for Drupal module](https://www.drupal.org/project/ckan_sync) for the open source community that can be added for configuration in a plug and play manner with any Drupal project. The module, developed by one of our developers, [Sergey Shchedrin](https://www.linkedin.com/in/sergii-shchedrin-04a958a4/?originalSubdomain=pl), allows developers to connect their Drupal site menu structure of any CKAN enabled open data management system [via what is known as a RESTful API](https://aws.amazon.com/what-is/restful-api/) (the interface that two computer systems utilise to request and send information over the Internet in a secure manner). ## What is it about [You can watch a video by Sergey explaining how to access and enable CKAN Sync is available on Link Digital’s YouTube channel here.](https://www.youtube.com/watch?v=Asadupx9kDk&list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj&index=4) It was recorded for [CKAN Demo Days 2024](https://ckan.org/blog/ckan-demo-days-on-open-data-day), a celebration of the impact, innovation and collaborative spirit of CKAN and the community around it. ## CKAN’s current version for Drupal The current version of CKAN Sync for Drupal has been released to provide others in the community with the opportunity to use and help improve the module. But [Link Digital](https://linkdigital.com.au/) already believes it promises immediate benefits in terms of supporting organisations to deliver public data via CKAN and digital services via Drupal. It represents an exciting way to maximise the native interoperability that is already present in these public facing open source digital projects – both of which are acknowledged [Digital Public Goods](https://digitalpublicgoods.net/registry/) (DPG) by the [Digital Public Goods Alliance](https://digitalpublicgoods.net/who-we-are/) – in a more meaningful way. ## Beyond the ecosystem Indeed, we believe the connection between CKAN and Drupal is something that will only increase, as demand grows for more sophisticated and interactive data sharing applications. It is also part of an expanding ecosystem of data and digital benefits being implemented over both projects into the future, such as [Rules as Code](https://www.govcms.gov.au/news-events/news/govcms-announces-enterprise-adoption-rules-code#:~:text=Rules%20as%20Code%20is%20the,better%20citizen%20or%20stakeholder%20experience.), [DCAT 3](https://www.w3.org/TR/vocab-dcat-3/) and [Public Code Standards](https://publiccode.net/standard-for-public-code/), which have the potential to increase the capacity to help deliver and improve public policy. [Link Digital](https://linkdigital.com.au/) is ready to start a conversation with you and your team on your open data needs. [Contact us and tell us about your project.](https://linkdigital.com.au/get-in-touch/) ## Watch the tutorial **Categories:** All articles, CKAN, Drupal, Open Data, Resources, Technology Infrastructure, Tutorial **Tags:** CKAN, Drupal --- ### [What does good data for AI mean and how can we get it?](https://linkdigital.com.au/news/2023/09/good-data-for-artificial-intelligence-what-does-it-mean-and-how-can-we-get-it/) **Published:** September 11, 2024 **Author:** Andrew Nette **Excerpt:** Open data has major benefits for AI. But it is not enough for that data to be open and shareable, it also needs to be quality data.  **Content:** - [Context first](#aioseo-introduction) - [Good data for AI: what does it mean and how can we get it?](#aioseo-good-data-for-ai-what-does-it-mean-and-how-can-we-get-it) - [Why good data matters for AI models](#aioseo-why-good-data-matters-for-ai-models) - [High-quality data for AI](#aioseo-high-quality-data-for-ai) - [What can be done to collect higher quality open data and to mitigate the risks with already existing open data that might exhibit problems?](#aioseo-what-can-be-done-to-collect-higher-quality-open-data-and-to-mitigate-the-risks-with-already-existing-open-data-that-might-exhibit-problems) - [Best Practices for Collecting and Curating AI Data](#aioseo-best-practices-for-collecting-and-curating-ai-data) - [The role of data in AI success](#aioseo-the-role-of-data-in-ai-success) - [How Link Digital supports AI with data management](#aioseo-how-link-digital-supports-ai-with-data-management) ## **Context first** The last couple of years have seen a tremendous increase in the tempo of debate around the benefits, problems and risks associated with Artificial Intelligence (AI). But what is not emphasised enough is that machine learning models only learn patterns and make predictions based on the data they are trained on. In other words, AI is only as good as the data that is fed into it. This is particularly the case for generative AI, the form of AI technology receiving perhaps the most public and media attention. Generative AI is an umbrella term for machine learning algorithms, such as [ChatGPT](https://chat.openai.com/), which generate artificial digital content. ‘Rather than merely processing existing data, generative AI entails the creation of models that can generate new content, such as images, videos, music, or text. Deep learning is a type of machine learning that employs neural networks to understand patterns and generate new data.’ 1 Link Digital understands that quality data is essential to creating what is increasingly being referred to as [‘ethical AI’](https://open.uts.edu.au/insights/professional-development/ai-and-data-trends-2023/) or [AI run on ethical principles](https://www.industry.gov.au/publications/australias-artificial-intelligence-ethics-framework/australias-ai-ethics-principles). That is an AI that is safer, more reliable, and more equitable. The following article offers a very brief explanation of what is meant by good data in the context of AI, and some recent protocols and guidelines that have been developed to help find or create it. This is the kind of topic that is also going to be discussed in a new series of public forums Link Digital has started hosting on the last Thursday of every month, Australian EST, the details of which are included at the end. ## Good data for AI: what does it mean and how can we get it? As AI is much discussed but arguably little understood, some basic definitions are useful to start with. [The Arts Law Centre of Australia](https://www.artslaw.com.au/) argues that while there is no one accepted definition of AI, it can be understood as ‘computer systems that are able to perform tasks normally requiring human intelligence. This includes visual perception, speech recognition, decision-making, translation between languages and generation of creative outputs.’2 The [Canadian Government’s 2023 *Directive on Automated Decision Making*](https://www.tbs-sct.canada.ca/pol/doc-eng.aspx?id=32592) defines AI as ‘Information technology that performs tasks that would ordinarily require biological brainpower to accomplish, such as making sense of spoken language, learning behaviours or solving problems.’ The [United Nations Education, Scientific and Cultural Organisation](https://www.unesco.org/en) (UNESCO) adds the key observation that AI can be divided into several interrelated disciplines, including natural language processing, knowledge representation, automated reasoning, machine learning and robotics. 3 What we now understand as AI has actually been around as early as 1950 when the English mathematician [Alan Turing](https://www.newscientist.com/people/alan-turing/) published [Computer Machinery and Intelligence](https://academic.oup.com/mind/article/LIX/236/433/986238), which proposed a machine intelligence test he termed ‘The Imitation Game’.4 The first rules to govern artificial intelligence systems, arguably the precursor to what we now refer to as ethical AI, the [‘Three Laws of Robotics’](https://webhome.auburn.edu/~vestmon/robotics.html), appeared the same year in American science fiction writer [Isaac Asimov](https://sf-encyclopedia.com/entry/asimov_isaac)’s anthology, *I, Robot*. The term ‘Artificial Intelligence’ was coined six years later by an American computer scientist called [John McCarthy](https://computerhistory.org/profile/john-mccarthy/). 5 Several factors have led us to where we are now, both in terms of AI’s growing abilities and the at times almost fevered debate around its transformative possibilities and dangers. Foremost is the massive expansion of computing power since the early 2000s, which has seen the gradual digitisation of nearly all key aspects of life and the ability of technology to help generate and capture data. These trends were accelerated by the COVID-19 pandemic, which resulted in increased data sharing within and between governments, and between governments and researchers to assist with research into finding effective vaccines and collaborate on measures such as contact tracing, much of which was also fed into AI applications. ## **Why good data matters for AI models** As a 2023 UNESCO report, [*Open Data for AI: what now?*](https://www.unesco.org/en/articles/open-data-ai-what-now) puts it, the current AI boom is largely based ‘on massive advancements in machine (and particularly) deep learning, which necessitates large data sets.’6 While some of these AI applications are run on closed or privately owned data, for the most part, they operate using open data, that is data ‘anyone can freely access, use, modify, and share for any purpose (subject, at most, to requirements that preserve provenance and openness).’7 Open data has major benefits for AI. Aside from the fact that it can accelerate the development of AI by making more data available on which to train it, open data can make it easier for policymakers, researchers and the public to compare the effectiveness of different AI models, which promotes greater transparency. But it is not enough for that data to be open and shareable, it also needs to be quality data. Major concerns around AI include its implications for privacy, security, reliability, accuracy, fairness and inclusion. In addition to posing longer-term ethical questions, these issues have very real and immediate implications. As the Canadian Government’s [*Directive on Automated Decision Making*](https://www.tbs-sct.canada.ca/pol/doc-eng.aspx?id=32592) puts it: ‘An AI tool could, for example, decide whether someone is eligible for a service, determine the level of benefits someone is entitled to, or process survey data to inform policy direction.’ Central to this concern is AI’s capacity to exhibit bias. This might occur in content generated by [ChatGPT](https://chat.openai.com/) or it might be a service decision influenced by an AI algorithm, either of which might be discriminatory, non-representative or based on stereotypes, including racial identity and gender. 8 The key source of this bias is the datasets from the open Internet which are being used to train AI and which contain biases that AI technology simply perpetuates. [Deloitte](https://www.deloitte.com/au/en.html) notes this bias can take several forms: ‘Induction bias’, which occurs ‘when an algorithm is trained on a dataset which provides limited interaction with varying demographics. For example, facial recognition systems that are trained primarily on the faces of white men are significantly more likely to misidentify the faces of women or minorities’; ‘latent bias,’ algorithms trained on historical data may stereotype; and ‘selection bias’, which is when a certain group is overrepresented in a dataset and another underrepresented.9 In addition to the implications for individuals or groups of people, inaccurate, out-of-date, incomplete data or biased data can have a significant impact on organisations and businesses. It can lead to incorrect assumptions and decisions and undermine trust in those providing digital services. As the [World Wide Web Foundation’s *Open Data Barometer*](https://webfoundation.org/research/open-data-barometer-fourth-edition/) noted, a lot of open data, including government data, is typically incomplete and can be of low quality.10 This can relate to problems in the way the data was collected, or the fact that it is not standardised or is mislabelled and/or from unknown sources. ## **High-quality data for AI** The call for quality data is one of the key principles of the movement around what is referred to as the [Third Wave of Open Data](https://opendatapolicylab.org/third-wave-of-open-data/). This emphasises that in addition to making data easy to find, access and understand, it must be of high quality. It is also in line with the FAIR principles, which seek to ensure open data can be accessed efficiently and that there is greater interoperability between data-sharing portals. First enunciated in a 2016 article in the open-access journal, *Scientific Data*, the [FAIR principles](https://www.go-fair.org/fair-principles/) are Findability, Accessibility, Interoperability, and Reuse of digital data.11 The [FAIR](https://www.go-fair.org/fair-principles/) acronym has also been interpreted as ‘Federated, AI–Ready’ to illustrate the importance that the data can be used by AI systems.12 FAIR in this context means that the data is Findable, Accessible, Interoperable and thus Reusable by both humans and machines. ### **What can be done to collect higher quality open data and to mitigate the risks with already existing open data that might exhibit problems?** In recognition that most AI systems are only as good as the data they are trained on, many organisations have developed laws and suggested protocols to help make data of higher quality. For example, [the European Parliament](https://www.europarl.europa.eu/portal/en) is about to [adopt new regulations](https://www.europarl.europa.eu/news/en/headlines/society/20230601STO93804/eu-ai-act-first-regulation-on-artificial-intelligence) that stipulate that foundation AI model providers, such as [Google](https://www.google.com/) and [ChatGPT](https://chat.openai.com/) owner [OpenAI](https://openai.com/), must describe data sources, including potentially copyrighted data, that have been used to train their AI models. The [UNESCO](https://www.unesco.org/en) [*Open Data for AI: what now?*](https://www.unesco.org/en/articles/open-data-ai-what-now) report notes the vital importance of effective governance frameworks to ensure data collected is of sufficient quality. This includes ensuring that the data is not outdated, is comprehensive and collected from credible sources. It should have been collected ‘with consent only and not in privacy-invasive ways. Data about people should be disaggregated where relevant, ideally by income, sex, age, race, ethnicity, migratory status, disability and geographic location.’13 ‘Efforts are required to convert the relevant data in a machine-readable format, which involves curating of the collected data, i.e., cleaning and labelling.’14 ## **Best Practices for Collecting and Curating AI Data** The European Parliament’s law, [UNESCO](https://www.unesco.org/en), Canadian Government’s [*Directive on Automated Decision Making*](https://www.tbs-sct.canada.ca/pol/doc-eng.aspx?id=32592), and [*Implementing Australia’s AI Ethics Principles: A selection of Responsible AI practices and resources*](https://www.csiro.au/en/work-with-us/industries/technology/national-ai-centre/implementing-australias-ai-ethics-principles-report), a 2023 report by [Australia’s Commonwealth Scientific and Industrial Research Organisation](https://www.csiro.au/) (CSIRO) and the not for profit [Gradient Institute](https://www.gradientinstitute.org/), particularly focus on measures to reduce potential bias migration in open data. Common themes include the need for fairness, privacy and protection of data, transparency and explainability. The [CSIRO](https://www.csiro.au/)/[Gradient Institute](https://www.gradientinstitute.org/) principles stress that there ‘should be transparency and responsible disclosure so people can understand when they are being significantly impacted by AI and can find out when an AI system is engaging with them.’15 They state that ‘when an AI system significantly impacts a person, community, group or environment, there should be a timely process to allow people to challenge the use or outcomes of the AI system.’16 The principles also stress the importance of participation, stating that enlisting the public, where appropriate and possible, to help correct bias, deliberately engaging with marginalised communities, and hiring staff from diverse backgrounds, disciplines and demographics.17 ## **The role of data in AI success** The Canadian Government’s [*Directive on Automated* ](https://www.tbs-sct.canada.ca/pol/doc-eng.aspx?id=32592)Decision-Making suggests a wide range of measures to minimise bias. These include reviewing content developed using generative AI for biases or stereotypical associations, formulating prompts to generate content that provides holistic perspectives and minimizes biases, and striving to understand the data that was used to train the tool in question, where it came from and how it was selected and prepared. ‘Open datasets also carry with them the imprint of how they were created. These datasets contain critical information reflecting a valuable historical record of transactions. But if those historical records are incomplete or reflect historical biases, they might train future AI models to recreate those biases.’ The [Canadian Directive](https://www.tbs-sct.canada.ca/pol/doc-eng.aspx?id=32592) is backed up by an explicit strategy of using data to foster equity, fairness and inclusion. Statistics Canada’s [*Disaggregated Data Action Plan*](https://www.statcan.gc.ca/en/about/smr09/smr09_138), created under the aegis of the *2023-2026 Data Strategy for the Federal Public Service*, includes the ambitious aim to break data down on specific population groups, with a current focus on Indigenous Peoples, women and people with disability. ## **How Link Digital supports AI with data management** As an organisation deeply committed to effectively leveraging open data to solve real-world problems, [Link Digital](https://linkdigital.com.au/) understands the necessity of creating ethical AI. One important way we can begin to have a meaningful impact in this area is through engaging in discussions about the importance of open data and how we can make it work for greater transparency, equity, and democratic accountability. This is one of the many topics that were discussed in a series of forums by [Link Digital](https://linkdigital.com.au/) for the past months. You can watch the [recording of Data Governance for AI that we hosted with Open North](https://youtu.be/Lu12A3x-yhc?si=TSOTM_PQmzVL1NAI). John Griffin shares Open North’s view on responsible AI usage in governance, reduce the focus on AI’s uniqueness, prioritise digital maturity, and address issues with solutions. ***You can also watch the other topics, such as:*** - [Open Data 2023 Privacy Enhancements (Queensland Government)](https://youtu.be/wwqLQoyTbjY?si=ySM9h-UQfDi_evMI) - [Insights on using Jira with the ERM Explorer solution to manage Energy and Resource Markets operations ](https://youtu.be/_XqnZgl_rPE?si=uqMScUe6XOEVQlWZ "Insights on using Jira with the ERM Explorer solution to manage Energy and Resource Markets operations ") - [Government Data: A Key to Canada’s Prosperous Future (with Jamie Boyd, National Digital Government Leader at Deloitte Canada)](https://www.linkedin.com/in/jaimieboyd/) These forums will connect you with like-minded experts who are passionate discussing about the importance of open data. Want to stay updated on the latest developments in the field? [Receive weekly updates from Link Digital.](https://linkdigital.com.au/newsletter) --- \[1\] United Nations Educational Scientific and Cultural Organisation, *Open data for AI: What now?* (UNESCO, Paris, 2023), 39, \[2\] Arts Law Centre, “Artificial Intelligence (AI) and copyright,” accessed September 19, 2023, \[3\] UNESCO, *Open data for AI*, 39. \[4\] Council of Europe, “History of Artificial Intelligence,” accessed September 19, 2023, \[5\] Ibid. \[6\] UNESCO, *Open data for AI*, 39. \[7\] “The Open Definition,” Open Knowledge Foundation, accessed September 18, 2023, \[8\] For examples see, “4 shocking AI biases,” *Prolific*, accessed September 18, 2023, ; and Terence Shin, “Real-life Examples of Discriminating Artificial Intelligence,” *Towards Data Science*,’ June 5, 2020, \[9\] Austin, Tasha, Kara Busath, Allie Diehl, and Pankaj Kamleshkumar Kishani, “Trustworthy open data for trustworthy AI: Opportunities and risks of using open data for AI,” *Deloitte Insights*, December 10, 2021. \[10\] World Wide Web Foundation, *Open Data Barometer, Global Report*, 4th edition, 14-15, \[11\] Mark D. Wilkinson, Michel Dumontier, IJsbrand Jan Aalbersberg, Gabrielle Appleton, Myles Axton, Arie Baak, and Niklas Blomberg, et al, “The FAIR Guiding Principles for scientific data management and stewardship,” *Scientific Data* 3, 160018 (2016): 1-9, \[12\] UNESCO, *Open data for AI*, 15. \[13\] Ibid,17. \[14\] Ibid, 18. \[15\] Alistair Reid, Simon O’Callaghan, and Yaya Lu, *Implementing Australia’s AI Ethics Principles: A selection of Responsible AI practices and resources*, (Gradient Institute and CSIRO, 2023), 28. \[16\] Ibid, 38. \[17\] Ibid, 15. **Categories:** All articles, Artificial Intelligence, Environmental/Climate Change, Government, Open Data **Tags:** FAIR Principles, generative ai, good data, Government, Machine learning, open data --- ### [Empowering organisations through open data](https://linkdigital.com.au/news/2024/09/empowering-organisations-through-open-data/) **Published:** September 12, 2024 **Author:** Andrew Nette **Excerpt:** The Link Digital paper examines these shifts and the rise of data, not just as a driver of economic value but as something to be made open and shared in the context of improving government policy-making and services and supporting civil society and a more informed citizenry. **Content:** Link Digital’s series of whitepapers explores aspects of the open data and digital ecosystem. ## Understanding of the current state of play Titled ‘Overcoming current and emerging challenges of the open data ecosystem for organisations’, the paper seeks to do two things. First, to provide a clear understanding of the current state of play relating to open data and data sharing. Second, to introduce Link Digital’s expertise and growing position within this data ecosystem and its value proposition to provide expertise and trusted guidance for organisations seeking to enter this space or build on their existing activities within it. ## The end of the dot-com boom in 2000 A lot of ink has been spilled, chronicling the end of the dot-com boom in 2000 and subsequent developments such as the emergence of companies such as [Google](https://www.google.com/), [eBay](https://www.ebay.com.au/) and [Amazon](https://www.amazon.com.au/). But less commented on was the subsequent change in how many organisations have structured their interactions with the data and digital space. Over the last decade, this has seen the convergence of previously separate IT, marketing and communications functions into digital teams with a different and more sophisticated relationship with data and its use. Parallel with this has been a significant transformation in how governments have collected and used data for service delivery and policy formulation, and a corresponding shift – turbocharged by the COVID-19 pandemic – of citizens accessing more government information and services digitally. ## Open data and data sharing The [Link Digital](https://linkdigital.com.au/) paper examines these shifts and the rise of data, not just as a driver of economic value but as something to be made open and shared in the context of improving government policy-making and services and supporting civil society and a more informed citizenry. With a growing recognition of the benefits of open data and data sharing, the paper examines the problems and the barriers preventing the open data movement from growing and reaching its full potential. It discusses some of the frameworks involved in data sharing, including the importance of the [Third wave of Open Data](https://opendatapolicylab.org/third-wave-of-open-data/) and the efforts made to standardise data and data sharing by adopting the [FAIR principles](https://www.go-fair.org/fair-principles/) to ensure public data can be accessed efficiently and to allow greater interoperability between data sharing portals. In addition, the paper explores the growing global importance of the [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN), a piece of open-source software launched in 2006 that can be configured and set up to function as an open data platform once it is deployed and hosted on a web server, of which Link Digital is a co-steward. ## Link Digital as a CKAN and data portal expert This wide-ranging discussion not only serves to highlight [Link Digital’s](https://linkdigital.com.au/) trajectory as a digital service organisation working at the intersection of open data and open source technology. It seeks to actively foreshadow what we believe is our evolving role in relation to the data ecosystem and the new uses that are emerging for open data: in corporate environmental, social, and corporate governance; in helping to foster government policies that address the needs of our rapidly evolving society; in combating disinformation and building trust in government and public institutions; and in helping to build models of artificial intelligence that are more trustworthy, safer, diverse and socially beneficial. Connect with like-minded experts passionate about the importance of open data and stay updated on the latest developments in the field. [Access the public forum playlist.](https://www.youtube.com/playlist?list=PLNYR4MdBNnu-vHzvMk92VVjG5UZO9Ed5K "Access the public forum playlist.") --- Link Digital specialises in developing open and internal data portals, geospatial and open data solutions that address real-world issues and drive meaningful change. [Get in touch.](https://linkdigital.com.au/get-in-touch/ "Get in touch.") **Categories:** All articles, CKAN, Open Data **Tags:** Amazon Web Services, CKAN, Drupal, open data --- ### [Welcome to Tuesday Tutorial: Articles to help you get the most out of CKAN](https://linkdigital.com.au/news/2024/04/welcome-to-tuesday-tutorial-articles-to-help-you-get-the-most-out-of-ckan/) **Published:** April 22, 2025 **Author:** Andrew Nette **Excerpt:** A series of seven Tuesday Tutorials on topics related to the Comprehensive Knowledge Archive Network (CKAN), by one of our global team of developers, Brett Jones. **Content:** *Last update: April 22, 2025* Launched in 2006, CKAN can be developed to function as an open data platform or internal data repository once it is deployed and hosted on a web server. Link Digital has been involved with CKAN since its beginning and we have extensive experience in using it in the development of cutting-edge data portals, internal data management systems, and metadata catalogues, as well as managed cloud hosting for CKAN. Link Digital takes our relationship with CKAN and the diverse open source community around it very seriously. We are a CKAN co-steward, one of its largest contributing developers, and are always keen to assist the software’s users to get the very most out of its always expanding functionality. ## **The Tuesday Tutorials focus on the following topics:** - April 30: [CKAN Platform – install using Docker Containers](https://linkdigital.com.au/news/2024/04/how-to-install-ckan-using-docker-containers/) - May 7: [CKAN Platform – install DataStore and DataPusher](https://linkdigital.com.au/news/2024/05/how-to-install-datastore-and-datapusher-on-ckan/) - May 14: [CKAN Extensions – install into a new Docker Development environment](https://linkdigital.com.au/news/2024/05/create-a-new-ckan-development-environment-and-install-a-new-extension/) - May 21: [CKAN Extensions – Updating Templates](https://linkdigital.com.au/news/2024/05/introduction-to-updating-ckan-templates/) - June 11: [CKAN Extensions – Using the CKAN Plugins toolkit](https://linkdigital.com.au/news/2024/06/using-the-ckan-plugins-toolkit/) - June 18: [CKAN Extensions – Creating a blueprint](https://linkdigital.com.au/news/2024/06/ckan-extensions-creating-a-blueprint/) - June 25: [CKAN Extensions – Actions and Authorisation](https://linkdigital.com.au/news/2024/06/ckan-actions-and-authorisation/) All these articles can be viewed as accompanying Brett’s [CKAN Installation Walkthroughs](https://www.youtube.com/playlist?list=PLNYR4MdBNnu9hGFdRNGZCX-OnU8Ug0dUx), which were posted on our YouTube channel in 2023, as well as his two articles, ‘[CKAN on Kubernetes’ and ‘Improving build times with CKAN and Docker,’](https://linkdigital.com.au/news/author/brettjones/) both of which remain the most visited pages on our website. ## **Video tutorials** Brett’s material also complements the 18 videos [recently posted on our YouTube channel](https://www.youtube.com/playlist?list=PLNYR4MdBNnu8EHbk7OrIwSvXdUpx0EEar) by another of our developers, Sergey Motornyuk. These focus on how CKAN’s functionality as open source software can be maximised through the deployment of a variety of plugins and extensions. The videos are in Russian language but non-Russian speakers are able to listen to them by [utilising the Chrome Browser plugin called Language Reactor, available here](https://chrome.google.com/webstore/detail/language-reactor/hoombieeljmmljlkjmnheibnpciblicm). - Click on the ‘Add to Chrome’ button, - Then click on the ‘Add Extension’ button in the pop-up window. The plugin will then be added to the Chrome browser extensions and made available (and running) when viewing Sergey’s videos on YouTube. Other languages, apart from English, are also available. Taken all together, Link Digital believes that these videos and articles represent one of the most comprehensive and detailed collections of CKAN instructional material available on the Internet. ## **Related online forum** If you are interested in CKAN and want to know more, there is a [wealth of case studies](https://linkdigital.com.au/case-studies/) and other articles on our site that showcase the power of CKAN and the ability of Link Digital help you on the next step on your data journey. ## CKAN Monthly Live This is a monthly event designed for CKAN users and is a space for the community to meet, get to know each other, and learn about the open source technology’s uses and applications. Each event includes multiple sessions and a live Q&A forum. You can find more details here: **Categories:** All articles, CKAN, Open Data **Tags:** CKAN, Tutorial --- ### [CKAN: continuing to fuel the growth of open data](https://linkdigital.com.au/news/2024/10/ckan-continuing-to-fuel-the-growth-of-open-data/) **Published:** October 4, 2024 **Author:** Steven De Costa **Excerpt:** Thinking about this post a decade on, I believe my question has been answered in the affirmative. Read the article. **Content:** **Table of contents** - [CKAN and the product life cycle](#aioseo-ckan-and-the-product-life-cycle) - [The centrality of data](#aioseo-the-centrality-of-data) - [Measuring CKAN’s uptake and impact](#aioseo-measuring-ckans-uptake-and-impact) - [CKAN: fuelling open data globally](#aioseo-ckan-fuelling-open-data-globally) [In a November 2014 post on this site](https://linkdigital.com.au/news/2014/11/is-ckan-fueling-the-growth-of-open-data-worldwide-or-c-kan/) I posed the question, is CKAN fuelling the growth of open data? This was prompted by an examination of Google Trends for four of the leading open data solutions, as indicated by worldwide search terms. This showed not only a increasing interest in the subject of open data but a greater attention to open source CKAN over other solutions, including Junar and DKAN and proprietary solutions such as Socrata. Thinking about this post a decade on, I believe my question has been answered in the affirmative. CKAN has and continues to play a substantial role in driving government transparency, accountability, openness, access, and knowledge, through open data initiatives. And in the process of doing this and helping to grow an ongoing demand for quality, easily discoverable open data by governments, citizens, researchers and businesses, CKAN has become more than just a product with a typical life cycle. It has achieved something of a perennial status because it is thought of as social technology that is as much about a mission as it is about a set of technological features. ## **CKAN and the product life cycle** The first thing that came into my mind when I was thinking about whether CKAN is fuelling the growth of open data for a 2024 audience, was the work of German-born American economist and a professor at Harvard Business School, [Theodore Levitt](https://en.wikipedia.org/wiki/Theodore_Levitt). [In an influential 1965 article in the *Harvard Business Review*](https://en.wikipedia.org/wiki/Theodore_Levitt), Levitt explored the concept of the product life cycle, from market development, to growth, to maturity, and decline. And he discussed the importance of businesses beginning to plan for the extension of the lives of their products, even before formally launching them. It occurred to me that rather than having a strict product life, CKAN is now recognised, to use the words of marketer Ryan Holiday, as a ‘perennial seller’. [As discussed in his 2017 book of the same name](https://www.amazon.com.au/dp/0143109014?geniuslink=true), a perennial seller occurs when a product continually finds new markets and audiences. The reasons behind this are complex but include the product’s market and purpose being at the forefront of thinking from its very inception. Indeed, the two seamlessly reinforce each other. Holiday’s proposition serves as an accurate description of CKAN. The guiding principle behind CKAN is that open data is a public good that should be non-right restricted and easily transferable, and that creates more value the more it is shared. In this way, in addition to creating public good, CKAN’s success in making quality data more open and discoverable also serves as its most durable and authentic form of marketing. ## **The centrality of data** What other evidence exists to back up the contention that CKAN is a perennial product which is continuing to help fuel the growth of open data? It’s now widely accepted that data is the main currency of the 21st century, a fact driven by the increasing digitisation of nearly all key facets of life and the ability of technology to help capture data. But there is also the clear recognition that data needs to be properly organised and made more open and easily discoverable, so that its value can be unlocked, whether this is for greater government transparency, a better informed citizenry, or improved public policy. CKAN is open-source data management software that can be configured and set up to function as an open data platform once it is deployed and hosted on a web server. Being open source means that the original source code has been made freely available, allowing anyone to redistribute and modify it. The purpose behind its design is to enable data to be published, shared, and discovered. It provides an easy-to-use interface for data publishers and users, that enables governments, organisations, researchers and the general community to upload datasets in various formats, allowing easy discovery and access. CKAN’s programming application interface and wide range of extensions make it highly adaptable to different needs, which in turn encourages its wider adoption. CKAN’s functionality has seen it become a central component in the development of open data initiatives over the last decade, particularly for governments and those involved in what is referred to as civic tech. According to [a 2016 paper by CKAN founder Rufus Pollock](https://rufuspollock.com/open-source-software-and-government/), civic tech is ‘digital technology (websites, apps and platforms) related to “civic” life. As defined, it includes most notably all government IT (whether in house or procured) but also includes technology created by others directly for citizens – from apps that let you register to vote to those that let you email your elected representative.’ A core civic tech agenda pursued by governments at all levels across the world has been the establishment of open data portals; front-line interfaces that bridge data providers and users, helping to ensure that data is not just accessible but usable. ## **Measuring CKAN’s uptake and impact** The most obvious way to measure CKAN’s central role in the increase in open data, is its uptake. CKAN is literally being used by millions of people world-wide each month. [Research in 2023 identified nearly 400 regularly updated CKAN data portals of different sizes in 59 countries](https://civicdataecosystem.org/2023/06/19/analysis.html). This includes some of the most significant open data portals in the world, such as [the German Government’s open data portal](https://www.govdata.de/), [the United States Open Data Portal](https://data.gov/), [Open Africa](https://africaopendata.org/), the largest repository of data on the African continent, and [Canada.ca](https://www.canada.ca/en.html), the official website of the Canadian Government. And the civic tech space will only continue to expand as governments collect more data, much of which they will have to organise and make open to meet not only the needs and expectations of their citizens. To cite a recent example of both the growing importance of civic tech and open source software such as CKAN’s importance in this, [in August the US administration pledged $US11 towards open source security initiatives](https://therecord.media/open-source-software-security-white-house-dhs-11million-funding). This is aimed at gaining a better understanding of how open source software is used across critical government infrastructure, including healthcare, transportation and energy production, and how to better secure it. But in addition to major players, much of CKAN’s usage is by individuals or small groups with only limited developer experience and resources, who are seeking to make data open. This is because CKAN is what is known as out of the box software, i.e., it can work immediately when placed into service. It can be set up and configured to function as an open or internal data platform once deployed and hosted on a web server. And because it is open source, the cost of accessing a CKAN instance is small compared to commercial software. How to better assist these smaller users is a key rationale behind the changes currently being made to CKAN – collectively known as CKAN 3.0. These are seeking to modernize the out of the box experience of CKAN. It is also the aim of an initiative known as ‘Civic Data Ecosystems’, carried out through a program known as [Pathways to Enable Open-Source Ecosystems (POSE)](https://new.nsf.gov/funding/opportunities/pathways-enable-open-source-ecosystems-pose). The second stage of this work, which was recently funded, seeks to strengthen the community around the software, including creating onboarding pathways for new people to contribute, improved documentation and governance, better tracking of CKAN adoption and help to get users up to speed with the latest version of the software. ## **CKAN: fuelling open data globally** To return to my central contention, CKAN has played a substantial role helping to fuel the growth of open data globally. In doing so it has established its perennial status because it is a technology that combines a social mission with a set of technological features. It is an almost cultural nexus between open source contributors, the public institutions that use it, the advocacy organisations that remain in alignment with it and the virtuous path it is on, sensitive to emergent ideas and concepts. While millions of dollars have been invested by companies in proprietary open data start-ups, CKAN remains completely free and downloadable for any government, institute, organisation. In this way, CKAN is proximal and always ready for advocacy organisations like [Open Knowledge Foundation](https://okfn.org/en/) and the [Open Data Charter](https://opendatacharter.org/) to use. And it is also central to the creation of affordable digital public goods – digital infrastructure contributes to sustainable national and international digital development – for governments and civil society organisations, many of whom would otherwise lack the means to establish and maintain this on their own. And it continues to be run and delivered with absolute excellence, and with eternal thanks, by singularly dedicated individuals from all over the globe. CKAN is for the people, built by the people and remains, as ever, a project that will evolve to serve the people. And Link Digital remains honoured to play a continuing role, along with so many people and organisations, in making this happen. ## **Let’s talk about your open data project** Does your organisation have an open data project it needs help with? Or do you require help to customise your CKAN application by taking advantage of the wide array of extensions available? If so, [contact us](https://linkdigital.com.au/get-in-touch/) and tell us about your project. **Categories:** All articles, CKAN, Higher Education/Research, Open Data **Tags:** CKAN, open data --- ### [Secure Data Exchange: a critical conversation for data portals](https://linkdigital.com.au/news/2024/11/secure-data-exchange-a-critical-conversation-for-open-data-portals/) **Published:** November 11, 2024 **Author:** Andrew Nette **Excerpt:** The SDE approach, outlined by Link Digital's Technical Delivery Manager, Lex Du Plessis, in a session at the recent 2024 Canadian Open Data Sumit, comes from our understanding of the challenges involving collaboration, trust, regulatory compliance, accountability and the safeguarding sensitive data, in the evolving open data ecosystem. **Content:** Table of contents - [Why Secure Data Exchange?](#aioseo-why-secure-data-exchange) - [What is Secure Data Exchange?](#aioseo-what-is-secure-data-exchange) - [Structured data sharing](#aioseo-structured-data-sharing) - [Access management](#aioseo-access-management) - [Customised metadata scheme](#aioseo-customised-metadata-scheme) - [Conclusion](#aioseo-conclusion) [Secure Data Exchange (SDE)](https://linkdigital.com.au/secure-data-exchange/) is a new capability by Link Digital to help data custodians in large organisations, primarily government agencies, exchange data in a completely secure manner across their domain. The SDE approach, outlined by Link Digital’s Technical Delivery Manager, [Lex Du Plessis](https://www.linkedin.com/in/lex-du-plessis-2594458a/?originalSubdomain=ca), in a session at the recent [2024 Canadian Open Data Sumit](https://www.opendatasociety.ca/etn/2024-canadian-open-data-summit/), comes from our understanding of the challenges involving collaboration, regulatory compliance, accountability and the safeguarding sensitive data, in the evolving open data ecosystem. It is also part of a broader trend in which the public governance achieved through open data and transparency fosters greater trust among individuals and institutions. ## **Why Secure Data Exchange?** But before we get to what SDE is, it is useful to briefly touch on why it is needed. During the COVID 19 pandemic, organisations and government’s recognised that their existing workflows were ineffective to face the challenges of the new environment. In the government context, the pandemic response triggered a frantic effort to create ad hoc data-sharing arrangements across various departments to address emerging gaps. This spanned not only healthcare and emergency response, but every area of the public sector. The urgency for data exceeded the existing processes designed for its responsible sharing, emphasising the necessity for a platform that can facilitate the secure exchange of data, complete with implementable and storable sharing agreements. Another driver concerns the timing of data sharing. Many of Link Digital clients have stringent workflows that govern when and how data can be published. This caution is entirely justified, as improper use of data could lead to harmful consequences. In such cases, diligence is essential—not because the data shouldn’t be published, but because it is the responsible course of action. The SDE is also a response to a broader trend in which large organisations and governments at all levels are collecting and using data more than ever to increase transparency and inform policy development and service provision. But as the amount of data increases, so do the challenges of effectively managing and sharing data across its life cycle. In addition to sharing data securely, these challenges include: - Deriving real insights and benefits from data. - Enabling staff to find the right data for their research or project, quickly and efficiently, ascertain its quality, and identify its custodian. The upshot of all of this is that large organisations and governments are now not only seeking high trust and near real-time support for their governance practices. They are looking to enhance their data governance and management; they are aiming for holistic improvements in governance practices. ## **What is Secure Data Exchange?** The secure data exchange is one outcome of new patterns of data sharing modelled on the open sharing of public domain data, ensuring interoperability, discoverability, and governance for reuse by institutional partners and key third parties. SDE is a powerful, flexible, and easy to use approach for data custodians to manage the complete lifecycle of their data across multiple departments, organisational branches, and internal and external users, in a completely controlled access environment. It offers three things: ### ***Structured data sharing*** SDE enables structured and secure data sharing that allows government departments and other large organizations to retain control of their important data while reaping the benefits of collaboration from its sharing. ### ***Access management*** SDE provides a streamlined and easy-to-use and interpret dashboard where they can view all data requests, their status (pending, final approval, ended), and all data sharing agreements. This includes the ability to revoke approval to use data. ### ***Customised metadata scheme*** A customized metadata scheme is incorporated into the workflow of the SDE system. This complies with the criteria set out in the latest Data Catalog Vocabulary standards, designed to facilitate interoperability between data catalogs. SDE won’t solve all the problems facing data custodians in government and other large organisations. But utilising open source software such as [CKAN, the Comprehensive Knowledge Archive Network](https://www.ckan.org/), and [Drupal](https://www.drupal.org/), a content management system used to build and manage websites, it can assist large organisations to develop the innovative solutions they require to simplify complex data sharing and delivery across their operations. And because SDE is open source, there are no licensing fees, making it not only an accessible but a cost-effective solution. SDE can make it easier and more efficient to reuse, evaluate and securely share internal data in one core data platform. It provides an intuitive and simple workflow to manage data requests, negotiate and generate data sharing agreements, grant and revoke data access, and discern patterns of data usage over time and across different levels of operations and functionality. ### **Conclusion** SDE allows data custodians to see all their data in one place. This ensures that there is one source of truth for the custodian’s data sets and prevents aged or incorrect data from being shared. SDE can assist large organisations to: - Build trust and accountability. - Improve the visibility of who is using data. - Improves data management. Link Digital can integrate SDE into a data lake, data stores, etc, so that the data sharing agreement is always pointing to the most up-to-date data in core systems. These operations all sit behind corporate Identity Access and Management systems, allowing confidence when users are updated on the core security platform. ## **Get in touch** Want to know more about SDE? [Visit the product page on our site here](https://linkdigital.com.au/secure-data-exchange/#:~:text=Book%20a%20call-,Key%20Features,-SDE%20leverages%20Link), or [tell us about your project](https://linkdigital.com.au/get-in-touch/), and one of our data experts will be in touch. **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Government, Internal data hub, Open Data **Tags:** CKAN, Drupal, open data, secure data --- ### [Using CKAN with Azure to build powerful data solutions](https://linkdigital.com.au/news/2024/11/using-ckan-with-azure-to-build-powerful-data-solutions/) **Published:** November 26, 2024 **Author:** Hoa Nguyen **Excerpt:** The following article will explore what Azure is and how organisations can use it with CKAN to build powerful data solutions. **Content:** Table of contents - [What is Azure?](#aioseo-what-is-azure) - [CKAN and Azure together: the different options](#aioseo-ckan-and-azure-together-the-different-options) - [Option 1: CKAN and Azure in the same instance](#aioseo-option-1-ckan-and-azure-in-the-same-instance) - [Option 2: CKAN and Azure in separate instances](#aioseo-option-2-ckan-and-azure-in-separate-instances) - [Want to know more about how Azure and CKAN can work together?](#aioseo-want-to-know-more-about-how-azure-and-ckan-can-work-together) At Link Digital, we work on many data management projects using the open source data management system known as CKAN – the [Comprehensive Knowledge Archive Network](https://ckan.org/). But Link Digital often uses CKAN in combination with a range of other tools, one of which is [Azure](https://azure.microsoft.com/en-au). My role at Link Digital is to help with the developer operations and infrastructure, and I’ve been working to expand our team’s capability to host and support CKAN on Microsoft Azure. The following article will explore what Azure is and how organisations can use it with CKAN to build powerful data solutions. ## **What is Azure?** Azure is Microsoft’s cloud computing platform. Link Digital utilises it to host open data platforms and enterprise data solutions using CKAN – software used to power internal data catalogues and public facing data portals that makes it easy for organisations to publish, share and work with data. Azure has a diverse range of services for data management, processing, and analytics, as well as different highly scalable storage options from small-scale to data lakes capable of serving as a secure repository for big data analytics. Azure can be easily integrated with CKAN to provide single sign-on functionality. CKAN’s application programming interface can be leveraged to interact with Azure services and custom extensions for CKAN can be developed and hosted on Azure. ## **CKAN and Azure together: the different options** To really understand how CKAN and Azure can work together to make a powerful data platform, we need to identify those basic CKAN components and match them to relevant Azure services. As a minimum, CKAN components require a relational database system ([PostgreSQL](https://www.postgresql.org/)), a search platform ([Solr](https://solr.apache.org/)) and a web platform (with CKAN’s [Python](https://www.python.org/) codebase). With an understanding of each separate component within the system, we can decide the topology to match the size requirements of the service instances. ### ***Option 1: CKAN and Azure in the same instance*** The first option, which is suitable for some clients, is to place all the components, the database system, search platform and web platform, into a single instance or virtual machine – a digitized version of a physical computer. There are limitations to this set up however, which many clients will experience. First is the poor handling of large volumes of traffic generated from end-users. Second, while the single instance typology is easy to build, it will take a lot of effort to maintain, upgrade and scale up. ![CKAN and Azure together](https://linkdigital.com.au/wp-content/uploads/2024/11/Using-CKAN-and-Azure-together-option-1-.png)Option 1: using CKAN and Azure together ### ***Option 2: CKAN and Azure in separate instances*** These problems can be fixed with the second option, deploying the components on separate instances and using the CKAN web application to connect them together. These service instances can also be built as a cluster. This provides convenience for the systems administrators during maintenance, as one instance can be repaired and upgraded, without disturbing the work of operation of the others. While making a service instance as a dependent node, a Web instance (Python) could be scheduled to scale out to multiple nodes during high peak hours or a small number of nodes on non-high peak hours. This second option is preferred for big data or enterprise-level operations, because it can handle much more traffic and the maintenance and/or upgrading of one instance does not take the whole service offline or interfere with the operations of the others. This provides: - High input and output. Input is the data sent to the computer system, while output is the data that is processed and comes from the system. The more nodes in an instance the better the communication between an information processing system, such as a computer and another information processing system. - High availability for business critical functions. This is the reduction or elimination of single points of failure to enable web applications to continue to operate even if one of the components it depends on fails or needs servicing. The drawback of option two is the cost. Link Digital utilised this second option in work for two clients. The first client was the Energy and Resources Markets Branch of New Zealand’s [Ministry of Business, Innovation and Employment](https://www.mbie.govt.nz/). The country’s regulatory steward for resources and energy market systems, the Branch holds a huge amount of data, including field seismic data on tape, and databases relating to mines, petroleum production, and data and documents relating to royalties, fees and permit related documents, including significant spatial data. The project involved replacing the Branch’s existing online data storage platform, which included an internal asset register, as well as a public facing portal. Link Digital helped to create separate instances for each of the main components, Postgres, Solr and [Redis](https://redis.io/) (an open source, in-memory data structure store that functions primarily as a NoSQL database, cache, and message broker). We also used Azure’s Active Directory Single Sign-On to allow for convenient log in to web based software applications. ![CKAN and Azure together, the configuration for MSF](https://linkdigital.com.au/wp-content/uploads/2024/11/Using-CKAN-and-Azure-together-option-2.-The-design-used-by-MSF.png)Option 2: using CKAN and Azure together, the configuration for MSF The second client was [Médecins Sans Frontières/Doctors Without Borders (MSF)](https://msf-au.raiselysite.com/donate/gapaid?campaign). MSF has a global federated structure comprising 26 self-governed associations, each of which is affiliated with one of five MSF Operational Centres. The organisation wanted to streamline and improve the sharing of research data collected by the organisation’s staff, including its field practitioners, both internally and with external third parties. After an initial exploration of the MSF’s internal data sharing capacity, the offices in the Netherlands and Japan jointly decided to develop a data sharing platform. Working with MSF staff, Link Digital augmented a CKAN-based data sharing infrastructure with Azure. This involved two instances: one combining Postgres, Redis, and Solr, and another containing the CKAN core and [nginx](https://nginx.org/en/), a web server, reverse proxy, content cache, load balancer, and mail proxy server. The build also utilised Azure’s single sign-on to enable users to conveniently connect to and use cloud-based apps over the Internet. [You can read more about Link Digital’s work with MSF here](https://linkdigital.com.au/project/medecins-sans-frontieres-data-sharing-platform/). Whatever option organisations choose to adopt, clients can pay for their web instance and pay an extra fee for our hosting services. And with an additional payment, clients can get improved input and output from the database and search service. To get an idea of the cost Link Digital would need to understand the size of any intended system and what is required to resource it. ## **Want to know more about how Azure and CKAN can work together?** [Get in touch with us](https://linkdigital.com.au/get-in-touch/) for more information about pricing your project. **Categories:** All articles, CKAN, Microsoft Azure, Open Data **Tags:** Azure, CKAN, data portal, enterprise data solutions --- ### [2024 in review: Four milestones at Link Digital](https://linkdigital.com.au/news/2024/12/2024-in-review-four-milestones-at-link-digital/) **Published:** December 17, 2024 **Author:** Kate Sampher **Content:** *This blog post was co-authored by [Andrew Nette](https://www.linkedin.com/in/andrew-nette-9780a4266?), Link Digital’s technical writer, researcher and analyst.* As has been the case since the company was founded as Link Web Services at the end of the dot-com bubble in 2001 and renamed Link Digital in 2004, this is not just about what we have done. It’s about the events we have taken part in and the networks, communities, and clients that we have the pleasure of working with in Australia and internationally. Here are four milestones that we think made 2024 another exciting and noteworthy year for us and the community. *Go to a specific topic*: - [Global clients](#aioseo-global-clients) - [Empowering open data communities globally](#aioseo-empowering-open-data-communities-globally) - [Secure Data Exchange](#aioseo-secure-data-exchange) - [Thought leadership](#aioseo-thought-leadership) ## Global clients Core to everything [Link Digital](https://linkdigital.com.au/) does is our commitment to providing high-quality tailored solutions to meet the needs of clients. This year we continued to work for a broad range of clients, from governments to not-for-profits and academic institutions. Among our international projects was ongoing work for the [Pacific Community](https://www.spc.int/), the principal scientific and technical organisation supporting development in the Pacific region. We also collaborated with long-term partner [Living Lakes Canada](https://livinglakescanada.ca/) on the development and implementation of a customised extension to improve the data visualisation capabilities of their award-winning [Columbia Basin Water Hub](https://data.cbwaterhub.ca/). The Hub is helping researchers and policymakers interpret environmental data more effectively and is empowering them with better tools for data-driven decision-making in support of ongoing conservation efforts. In Australia, we finalised the website for the new [Vehicle Emissions Star Rating](https://www.vesr.gov.au/) (VESR). A New South Wales program endorsed by the Commonwealth Government and all states and territories, the VESR website is designed to assist Australian consumers to factor in the environmental impact when planning their next vehicle purchase. We worked with the NSW Government on several other projects: an internal asset register that now services two state government departments, the Department[ of Planning, Housing and Infrastructure](https://www.nsw.gov.au/departments-and-agencies/department-of-planning-housing-and-infrastructure) and [Department of Climate Change, Energy, the Environment and Water](https://www.nsw.gov.au/departments-and-agencies/dcceew); the highly innovative [Data4Me project](https://linkdigital.com.au/project/the-new-south-wales-department-of-climate-change-energy-the-environment-and-water-data4me-project/), an internal-facing data portal designed to identify and smooth over the pain points that occur over the workflow involved in using data; and the ongoing revamp of the [Sharing and Enabling Environmental Data (SEED) portal](https://www.seed.nsw.gov.au/). SEED added a multi-hub service with the launch of several integrated themed hub environments, and Link Digital worked to add the Koala Hub. This involved integrating the abilities of CKAN – [ the Comprehensive Knowledge Archive Network](https://www.ckan.org/) – with advanced data management features, enabling improved data-sharing functionalities and cross-sector collaboration for development projects. In addition to our existing customers, going into 2025 we are excited to add several large international clients, including a new Canada-based project, a leading European educational institution, and a major multilateral agency. ## Empowering open data communities globally It has been another big year for CKAN and for Link Digital’s role as one of its co-stewards. With a dedicated team of experts, Link Digital continued to play a major role in the CKAN ecosystem by providing solutions for open data portals worldwide. But Link Digital’s role in relation to CKAN is not only about data as a driver of economic value. We also strive to continue to help build and strengthen the community of like-minded people interested in open data and stay up to date with the latest developments in the field. The growth of CKAN and its community, and the software’s increasingly important role as a form of digital public infrastructure, informed two announcements by Link Digital in 2024. First, in May, Link[ Digital announced a substantial investment to fund several new roles targeted at enhancing CKAN’s core capabilities](https://linkdigital.com.au/news/2024/05/link-digitals-major-initiative-to-boost-ckan-development/). These new roles, in addition to our current support for the software, focused on: - Support for CKAN to improve interoperability with [Data Catalog Vocabulary (DCAT) 3](https://www.w3.org/TR/vocab-dcat-3/), the global standard for making data catalogs interoperable. - Providing a better user experience and enhanced file management. These capabilities also align with improvements as part of the release of the next version of CKAN, known as v3.0, and are very much aimed at helping smaller and less resourced users to get more out of CKAN’s out of the box experience. Second, are ambitious changes to Link Digital’s operations, announced by founder and Chairman, [Steven De Costa](https://www.linkedin.com/in/stevendecosta). These include the transition to a different operating model and the establishment of a public beneficiary fund that would sit above Link Digital’s commercial entity. This fund aims to supplement government funding for civic tech initiatives involving digital public goods, collaborative governance, and public code globally. [You can read more about these future plans here](https://linkdigital.com.au/news/2024/07/link-digital-to-establish-beneficiary-fund-for-digital-public-goods/). ## Secure Data Exchange Another highlight of 2024 was the successful rollout of [Secure Data Exchange (SDE)](https://linkdigital.com.au/news/2024/06/introducing-link-digitals-secure-data-exchange/) as part of starting a broader conversation on the topic of how to securely exchange data using CKAN and [Drupal](https://www.drupal.org/), a content management system used to build and manage websites. A new capability to help data custodians in large organisations exchange data in a completely secure manner across their domain, SDE comes from our understanding of the challenges involving collaboration, regulatory compliance, accountability, and the safeguarding of sensitive data. It is also part of a broader trend in which the public governance achieved through open data and transparency fosters greater trust among individuals and institutions. SDE is a powerful, flexible, and easy to use approach for data custodians to manage the complete lifecycle of their data across multiple departments, organisational branches, and internal and external users, in a completely controlled access environment. It offers structured data sharing, a streamlined and easy-to-use and to interpret dashboard where they can view all data requests, their status (pending, final approval, ended), and all data sharing agreements. This includes the ability to revoke approval to use data, and a customized metadata scheme. SDE won’t solve all the problems facing data custodians in government and other large organisations. But it can assist large organisations to develop the innovative solutions they require to simplify complex data sharing and delivery across their operations. [You can learn more about SDE here.](https://youtu.be/0ANYXq_updc) ## Thought leadership 2024 saw Link Digital continue to amplify our voice in open source and open data forums. At the [State of Open Con](https://stateofopencon.com/), Link Digital’s [Chief Technology Officer, Paul Walsh](https://www.linkedin.com/in/prwalsh/?originalSubdomain=il), presented at a high profile panel on [reimagining open data portals](https://linkdigital.com.au/news/2024/02/reimagining-open-data-portals-debates-and-research-paths/), which has led to Paul being involved in an exciting research project related to the topic. International open data week is celebrated globally, in person and virtually. Link Digital experts participated in this through the [CKAN Demo Days](https://ckan.org/blog/ckan-demo-days-on-open-data-day). These allowed contributors from diverse backgrounds to share stories, projects, and insights about CKAN. [The full playlist is available here.](https://youtube.com/playlist?list=PLNYR4MdBNnu_LDYZ_tbZKuQ2nhE9-Ddfj&si=iKNm-lgGiUWXuNfl) Our expertise was on display at the [Canadian Open Data Society’s](https://www.opendatasociety.ca/) Canadian Open Data Summit, where representatives from our Canadian office presented on the new SDE capability and contributed to critical discussions on CKAN and open data. In November, Link Digital’s Spain-based Senior Solutions Architect, [Adrià Mercader](https://www.linkedin.com/in/adriamercader/?originalSubdomain=es), participated in a [panel at the annual conference of CLARIN (Common Language Resources and Technology Infrastructure](https://www.clarin.eu/event/2024/building-bridges-industry-clarin2024)), a network of mostly European research centres specialising in language research to support humanities and social science. [Adrià discussed the challenges and lessons of building bridges between CKAN and the private sector.](https://linkdigital.com.au/news/2024/11/expanding-the-reach-and-building-connections-lessons-from-the-ckan-project/) And the provision of resources for the CKAN community continued to be a core part of our work. Earlier this year, [we launched Tuesday Tutorials presented by one of our global team of CKAN experts, Sergey Motornyuk](https://youtube.com/playlist?list=PLNYR4MdBNnu8EHbk7OrIwSvXdUpx0EEar&si=8zD6wr7GZoERli-F). The videos are in Russian, but you can easily install an add-on for English translation. Also popular was a series of [articles on various aspects ](https://linkdigital.com.au/resources)of CKAN by our DevOps Engineer Brett Jones. We also launched [’Tuesday Talks with Alex Gostev’](https://youtube.com/playlist?list=PLNYR4MdBNnu_50tgZti4Nmlon5AF7k6aL&si=qHR5F24NTvhMNrGH), a video series designed to educate and inspire new audiences and strengthen our position as a CKAN expert. ## Looking Ahead to 2025 As we look toward the new year, our vision remains the same: to empower organisations with open-source solutions that make data management accessible, secure, and impactful. Our mission to create meaningful change also remains the same. This won’t happen overnight; it will continue as we believe in our team, clients, and community. None of this would have been possible without the dedication of the people involved. Here’s to a successful 2024 and an even brighter 2025. Thank you for being part of our journey. **Categories:** All articles, Kate Sampher, Open Data, Thought Leadership **Tags:** CKAN community, open data, Thought Leadership --- ### [How to launch successful data portals: No-BS guide for organisations](https://linkdigital.com.au/news/2025/01/how-to-launch-successful-data-portal-no-bs-guide-for-organisations/) **Published:** January 14, 2025 **Author:** Kate Sampher **Content:** Here’s the truth: successful data portals start with understanding users, not technology. - [Start with these fundamental questions](#aioseo-start-with-these-fundamental-questions) - [Here's how to gather real insights](#aioseo-heres-how-to-gather-real-insights) - [The secret to measuring success? Track these metrics.](#aioseo-the-secret-to-measuring-success-track-these-metrics) - [Two often-overlooked keys to success](#aioseo-two-often-overlooked-keys-to-success) - [Related: Watch the YouTube video from the first episode of Tuesday Talks](#aioseo-related-watch-the-youtube-video-from-the-first-episode-of-tuesday-talks-with-alex-gostev) ## Start with these fundamental questions 1. What data do you actually have? 2. Who needs to use it (and why)? 3. How secure does it need to be? ## Here’s how to gather real insights - List user personas - Pick 3 colleagues from different teams - Have informal coffee chats (yes, really) - Ask directly, “What’s your biggest headache when working with data?” - Refine questionnaire and polish the interview questions - Pick 3-5 colleagues per persona - Keep the interview structure - Build a list of repeated pain points - Look for patterns in the feedback - When answers are repeating, the research is completed ## The secret to measuring success? Track these metrics. - Weekly portal visits - Number of data downloads - User satisfaction scores - Cross-team collaboration instances ## Two often-overlooked keys to success 1. Start simple and iterate based on actual usage 2. Celebrate quick wins to build momentum Remember, your data portal’s success isn’t about features itself. It’s about whether users can find and use the data they need to do their jobs effectively. The best data portals don’t just store information; they break down silos and create shared spaces where teams can work together. Begin with basics, measure what matters, and grow based on real needs. That’s how you build a data portal that actually works. [Link Digital is ready to help you](https://linkdigital.com.au/get-in-touch/) if you don’t know where to start or if you are stuck in the process of building your data portal; our experts will assist you in advancing your infrastructure and data portal strategy. — ## Related: [Watch the YouTube video from the first episode of Tuesday Talks ](https://www.youtube.com/watch?v=iIiXBm53L9A&t=9s) - [LinkedIn](https://www.linkedin.com/company/link-digital/) - [YouTube](https://www.youtube.com/@link-digital) **Categories:** All articles, CKAN, Government, Higher Education/Research, Internal data hub, Open Data **Tags:** CKAN, data portal --- ### [Insights on data governance from Akira Bell, Chief Information Officer, Mathematica](https://linkdigital.com.au/news/2025/01/insights-on-data-governance-from-akira-bell-chief-information-officer-mathematica/) **Published:** January 29, 2025 **Author:** Kate Sampher **Content:** - [Who is Mathematica?](#aioseo-who-is-mathematica) - [Commitment to data quality](#aioseo-commitment-to-data-quality) - [On governance and security](#aioseo-on-governance-and-security) ## Who is Mathematica? Mathematica is a research and data analytics consultancy that is employee-owned and dedicated to enhancing public well-being. They work at the intersection of data, social science and technology to turn big questions into deep insights, reimagining how the world collects, analyses, and applies data to solve pressing problems. ## Commitment to data quality The foundation of [Mathematica’s ](https://www.mathematica.org/)success lies in their commitment to data quality. Working with sensitive government data, particularly in healthcare and social services, requires more than well-defined security measures. It demands a comprehensive approach to data governance. Bell’s team recognized early on that data quality issues could severely impact their ability to serve agencies like [Medicare](https://www.medicare.gov/) and [Medicaid](https://www.medicaid.gov/) effectively. Rather than accepting this limitation, they took an innovative approach: partnering with [New Wave](https://newwave.io/) to develop [Imersis](https://www.mathematica.org/solutions/imersis), a cloud-based data quality platform. For data stewards, the key takeaway is clear: when faced with data quality challenges, consider looking beyond your organization’s boundaries. Strategic partnerships can bring complementary expertise and accelerate solutions. [![CKAN & Open Data](https://linkdigital.com.au/wp-content/uploads/2024/10/ckan-logo-1.webp)](https://linkdigital.com.au/ckan-and-open-data/)[*Publish your data easily with CKAN*](https://linkdigital.com.au/ckan-and-open-data/) ## On governance and security Bell’s approach to emerging technologies like AI offers another valuable lesson. Despite the pressure to adopt new solutions, Mathematica takes a measured approach. They’re currently evaluating AI technologies through careful [“bake-offs”](https://amazingalgorithms.com/definitions/bake-off/#:~:text=lightbulb-,Bake%2DOff,weaknesses%2C%20and%20overall%20performance%20of%20the%20products%20in%20a%20controlled%20environment.,-What%20does%20Bake) – testing multiple technologies and tools to determine which is the best one for the purpose at hand – behind closed doors, prioritizing governance and security before commencing any production implementation. This methodical approach to innovation aligns with best practices in data stewardship. It reminds us that rushing to implement new technologies without proper governance frameworks can create more problems than it solves. Perhaps the most practical lesson from Bell’s experience is the importance of building a solid foundation before attempting more advanced initiatives. Mathematica’s journey began with strong networking and security infrastructure, followed by cloud migration, and only then moved to developing sophisticated analytical platforms. We’re often caught between the pressure to innovate and the need to maintain data quality and security. Bell’s approach at Mathematica shows that these aren’t mutually exclusive goals. By focusing on strong foundations, ethical considerations, and strategic partnerships, we can create data systems that not only meet technical requirements but also serve their intended purpose: improving outcomes for the people who depend on our services. Good data stewardship isn’t just about managing data. It’s about ensuring that data serves its highest purpose in improving people’s lives. That’s a lesson worth carrying forward in all our data initiatives. ## Let’s start the conversation Link Digital is a global data catalog services company, operating out of Canada and Australia with clients around the world. If you’d like to explore how your organization’s data catalog system can enhance data quality, [I’d be happy to help start the conversation.](https://linkdigital.com.au/get-in-touch/) **Categories:** All articles, Higher Education/Research **Tags:** Data governance, Data quality --- ### [The power of merit: creating value with CKAN](https://linkdigital.com.au/news/2025/02/the-power-of-merit-creating-value-with-ckan/) **Published:** February 7, 2025 **Author:** Kate Sampher **Excerpt:** What immediately struck me was CKAN’s true meritocratic spirit. Read more. **Content:** ## **My CKAN journey** My journey with CKAN began as a product owner and contributor back in 2022. What immediately struck me was CKAN’s true meritocratic spirit. This was evident in how the CKAN Tech Team and co-stewardship operated: open collaboration and open contributions on GitHub; Gitter as a forum where anyone can ask technical questions and get their own problems solved; the culture of collaboration through contributions. This meritocratic approach extended to how we gathered and acted on [community input](https://docs.google.com/presentation/d/1TwIUTDjLWgz8Qj3CQStUVvFkFCbjdRH3I3dOQ5f4TH4/edit#slide=id.gf4322e059a_0_1). Through 37 interviews across 17 countries, we learnt from maintainers, developers, and users regardless of their role or organisation size. Ideas that made it into development weren’t chosen based on who suggested them but on their potential impact—whether they came from established organisations like GSA’s data.gov team or individual community contributors. The collaborative nature of decision-making was particularly visible in the CKAN community’s [UI Revamp initiative](https://github.com/ckan/ckan/discussions/8188). Rather than decisions being made top-down, we saw CKAN contributors and designers like Petar and Eucharia receiving feedback from the wider community right in [Figma files](https://www.figma.com/design/oI3wDSdZ0cHZLh6CrfYMnb/CKAN-3.0-Design-System?node-id=546-2693). Alex and Stephen worked with core developers like Adrià and Patricio, each contribution evaluated on its technical merit and user benefit. Even when discussing major architectural changes like [ElasticSearch integration](https://github.com/ckan/ckan/issues/7492) or [harvester improvements](https://github.com/ckan/ckan/issues/7492), the focus was always on technical soundness and community benefit rather than organisational authority. ## **Great ideas have a unique power** When backed by meaningful action, great ideas can create successful endeavours and thriving open source communities. At Link Digital, we’ve seen this principle play out in two parallel journeys: our growth as a company and our involvement in the CKAN open data project. Meritocracy can be focused on individual achievement and competition. But there’s another model that fits the open source world much better, where merit comes from contributing value to a shared mission. Here, the best ideas and most impactful work naturally arise, regardless of title, position, or anything that’s not the value of the idea itself. This points to an exciting possibility—that a merit-based contribution can create organisational coherence even without traditional hierarchies. When people unite around a compelling mission and are recognised for their concrete impact, natural leadership emerges. We see this clearly in CKAN’s evolution. Technical decisions are driven by those who consistently show up and contribute, not by formal power structures. The key insight is that merit-based systems work best when they’re truly open—when anyone can contribute and be recognised based on their impact. This creates resilient organisations that can gather and build diverse talents toward shared goals. The future belongs to those who show up, contribute meaningfully, and help others succeed. True meritocracy means the best ideas can come from anywhere. What matters is turning those ideas into reality. *Read my article on CKAN.org on[ UI Revamp Project: path to deliver modern default UI for CKAN](https://ckan.org/blog/ui-revamp-project-path-to-deliver-modern-default-ui-for-ckan)* ## **Join the CKAN community** As co-stewards of the CKAN project, I highly encourage passionate developers and enthusiasts to join the community on the following platforms: - [GitHub](https://github.com/ckan/ckan/discussions) – for open collaboration and contribution, - [Gitter](https://app.gitter.im/#/room/#ckan_chat:gitter.im) – for technical Q&As in a feed format, - You can also subscribe to the project’s [newsletter](https://ckan.org/newsletter/subscription/) or get it on [LinkedIn](https://www.linkedin.com/newsletters/ckan-monthly-newsletter-7026887622375424001/). What if the next breakthrough in open data came from your insight? What if your strategic thinking or hands-on building could help governments serve citizens better? These aren’t hypothetical questions. They’re real possibilities waiting for people ready to act on them. - [LinkedIn](https://www.linkedin.com/company/link-digital/) - [Facebook](https://www.facebook.com/LinkDigital) - [YouTube](https://www.youtube.com/@link-digital) **Categories:** All articles, CKAN, Government, Higher Education/Research, Open Data **Tags:** CKAN, CKAN community, open data --- ### [Data Challenges of Smart City Digital Twin Initiatives: How CKAN can help](https://linkdigital.com.au/news/2025/02/data-challenges-of-smart-city-digital-twin-initiatives-how-ckan-can-help/) **Published:** February 25, 2025 **Author:** Andrew Nette **Excerpt:** Let’s look at digital twin technology in the context of one of its common uses, smart city initiatives, and the data challenges involved in these. As part of this, I want to discuss how CKAN can help. **Content:** But, [as a recent Organisation for Economic Co-operation and Development (OECD) report on government innovation identified](https://www.oecd.org/en/publications/global-trends-in-government-innovation-2024_c1bc19c3-en.html), governments are increasingly drawing on non-traditional data sources to help design and implement better services. They are also using experimental tools to help navigate difficult and unpredictable environments. One popular tool utilising non-traditional data sources the OECD highlights is simulations known as a digital twin. Let’s look at digital twin technology in the context of one of its common uses, smart city initiatives, and the data challenges involved in these. As part of this, I want to discuss how [CKAN](https://ckan.org/), an open source software with a global reputation for building management solutions, can help to support digital twin initiatives by ensuring standardised data management and seamless real-time information sharing across the complex collaborative data ecosystems necessary for these to function. **Table of contents** - [What is a smart city?](#aioseo-what-is-a-smart-city) - [The digital twin: an old idea given a high tech makeover](#aioseo-the-digital-twin-an-old-idea-given-a-high-tech-makeover) - [Where can digital twins help most?](#aioseo-where-can-digital-twins-help-most) - [How CKAN can help meet the challenges of the smart city digital twin approach](#aioseo-how-ckan-can-help-meet-the-challenges-of-the-smart-city-digital-twin-approach) - [Success stories of Digital Twin with CKAN](#aioseo-success-stories-of-digital-twin-with-ckan) - [The city of Munich](#aioseo-the-city-of-munich) - [The province of Bavaria](#aioseo-the-province-of-bavaria) - [Conclusion](#aioseo-conclusion) ## What is a smart city? The [European Union defines a smart city](https://commission.europa.eu/eu-regional-and-urban-development/topics/cities-and-urban-development/city-initiatives/smart-cities_en) as an urban space where ‘traditional networks and services are made more efficient with the use of digital solutions for the benefit of its inhabitants and business’. The concept came into being in the late 1990s and is still evolving and has no universal definition. Data is gathered by sensors, cameras, smart metres and geospatial technology devices installed throughout the city. It is then integrated with advanced data analytics and, increasingly, artificial intelligence to enable more informed and responsive decision making in relation to the efficiency, liveability and sustainability of built-up urban spaces. Crucially, data is also fed back to residents and city workers via websites and apps that can enable them to do everything from report power outages and accidents, to paying fines and receiving news of cancelled services. Smart city technology has many uses: monitoring traffic and pollution levels, smart lighting and heating, alerting council workers to when a public waste bin needs to be emptied, and motion sensors to help the elderly safely cross a road. Some smart city models can detect when a car passes a toll booth and deduct a toll from a user’s account and even allow for a variable toll to be assessed based on traffic conditions. Smart parking-metres can communicate with a central server and then to a user app to advise a driver when a parking space is available and guide them to it. Singapore, Japan and Spain utilise smart city technology to improve traffic flow and public transport by combining a central system for traffic light controls with sensors for detecting delays or the amount of traffic at a particular intersection. The system can adjust the timing of lights, buses and emergency vehicles, depending on how well traffic is flowing, or suggest alternative routes. South Korea has adopted the technology to monitor pedestrian safely and mobility. Amsterdam has focused on smart waste management and sustainability. ## The digital twin: an old idea given a high tech makeover The digital twin takes an idea with a lengthy history and gives it a digital makeover. That is, in the words of [the American Planning Association](https://www.planning.org/planning/2021/spring/smart-city-digital-twins-are-a-new-tool-for-scenario-planning/), ‘when most industries set out to develop a new product or solve a problem, they rely on using laboratories, testbeds, or other workspaces to refine and optimize their ideas.’ While engineers, construction companies and town planners have long used computer generated designs to plan and create projects, smart city technologies can now deliver real time data to build a simulated virtual interactive model of an entire city on which to test policy alternatives and future scenarios. According to the [American Planning Association](https://www.planning.org/planning/2021/spring/smart-city-digital-twins-are-a-new-tool-for-scenario-planning/), a smart city digital twin depends on the various data layers that build on top of each other, including data on topographical features, buildings and infrastructure, and the movement of people and traffic, etc. ‘The digital twin uses the data generated in the virtual smart city layer to perform additional simulations; this information is fed back through the layers of the model, where it can be implemented in the physical world.’ Also crucial to the digital twin model is a range of other technologies that have been increasing in sophistication: cloud computing, artificial intelligence, and 3D geospatial mapping and immersive visualisation, such as virtual and augmented reality. ## Where can digital twins help most? A digital twin enables urban planners, designers and engineers to measure the potential impact of changes before they are implemented and improve or modify their plans. Incorporating continuous real-time data into evaluation, modelling and planning also enables planners and policy makers reduce time lags associated with conventional feedback loops and learn quicker from mistakes. Other potential benefits cited in the OECD report include facilitating improved stakeholder collaboration, and better services, whether this is improved traffic flow, or smarter heating, ventilation and air conditioning, leading to reduced carbon emissions. Ideally, smart city digital twin technology can also facilitate better communication between residents and city authorities and promote public participation in urban planning and decision-making. ![](https://linkdigital.com.au/wp-content/uploads/2025/02/2-CKAN-for-Smart-City-Digital-Twin-Initiatives-1024x535.jpg)*An approach to data management and analytics for smart city applications, showcasing how CKAN powers data-driven insights and digital twin services.* ## How CKAN can help meet the challenges of the smart city digital twin approach Alongside their benefits, smart city digital twin technology presents significant challenges. This includes maintaining public trust in the face of increased use of surveillance technology, such as CCTV cameras and facial recognition technology. This public trust factor is connected to what some refer to as ‘obtaining a social license’ by ensuring that data re-use initiatives are transparent and create public good. There are also significant data challenges in maintaining a digital representation of a physical urban space. Large amounts of data are collected from a range of different digital technologies. It comes in different formats, including both geospatial and real-time data. And the data needs to be securely stored and properly organised so it can be analysed and shared between multiple stakeholders. ## Success stories of Digital Twin with CKAN Let’s focus on two examples where CKAN has successfully been used to meet the data challenges of smart city digital twin projects. ### The city of Munich The first is the digital twin for the city of Munich. [A 2022 paper by researchers at the School of Engineering and Design at the Technical University of Munich](https://isprs-annals.copernicus.org/articles/X-4-W3-2022/119/2022/), notes one traffic-related project alone generates a wide range of digital resources, in different data formats and maintained by different municipal departments. ‘This includes city models (.citygml), topographic data (.gdb, .shp), site plans (.pdf, .dwg), meshes (.obj), point clouds (.las), visualization formats (.czml, .udatasmith) but also simulation results (.csv, .xml). Realtime data is provided by sensor Web services (implementations of the OGC SensorThings API). In addition, with applications using this data as well as a number of different stakeholders, this results in a complex and distributed UDT \[urban digital twin\].’ CKAN is used as the foundation for the extensive catalogue that securely manages the data. These resources are shared [on the City of Munich open data portal](https://stadt.muenchen.de/infos/connected-urban-twins.html), also powered by CKAN, with the aim of improving public participation. As part of the [Connected Urban Twins](https://www.connectedurbantwins.de/) project, the city of Munich is also collaborating on digital twin technology with Hamburg and Leipzig, an initiative which also uses CKAN. ### The province of Bavaria The second example is an initiative overseen by the State Ministry for Digital Affairs in the southeast German province of Bavaria, to support 17 municipalities to create digital twins. The project seeks to enable municipalities that lack the skills and resources, to develop and maintain their own smart city digital twin infrastructure and utilise it to plan and implement urban projects faster and at reduced cost. Municipalities were given the option of setting up their own cloud storage catalogue or using [a central data infrastructure developed by the Technical University of Munich and powered by CKAN](https://github.com/tum-gis/ckan-docker). All 17 chose to go with the centrally provided instance. The central catalogue uses a version of the CKAN software prepared for deployment in a [Kubernetes](https://kubernetes.io/docs/concepts/overview/) cluster – an open source platform for managing containerised workloads and services. The abilities of the main CKAN instance are further enhanced through extensions, including for managing geospatial datasets and metadata. The instance is also configured to enable the setting of different access rights for users. **CKAN can support smart city digital twin initiatives in many ways.** - Interoperability and seamless communication between the various digital twin technology components. In Madrid, for instance, CKAN has been used to share a large quantity of parking data from different sources in a machine readable format as Linked Open Data, which the urban twin then utilises for traffic management and real time parking updates. - Metadata management and interoperability. CKAN can be used to create and manage a centralised and comprehensive descriptive record of data that goes far beyond collecting basic metadata, making data more discoverable. CKAN can also be used to catalogue diverse datasets and provide a centralised platform for stakeholders to analyse shared datasets, crucial for collaboration across diverse digital twin systems and stakeholders. - Real-time data integration can ensure that planners, policy makers and other stakeholders access up to date digital twin data for faster, improved decision making. - Enhanced security, including the ability to limit access to selected datasets by setting group and individual permissions. It also allows for version control and audit trails, so any changes can be tracked, and data accountability and traceability are enabled. The fact that CKAN is open source and easily used means organisations can avoid license fees and vendor lock-in. This makes it more accessible and cost-effective, especially for small to medium-sized smart city digital twin projects. This is an important consideration, given that globally municipal city and national government funding remain the primary sources of funding for smart city digital twin projects. ## Conclusion Increasing urbanisation and the challenges of making cities more liveable, coupled with advances in digital technologies, mean smart city digital twin initiatives will continue to grow in popularity across the globe. CKAN is already supporting governments in this area by ensuring the standardised management of complex and diverse datasets from non-traditional sources, seamless information sharing and real time interoperability across the various stakeholders involved and the collaborative data ecosystems necessary for them to function. ## **Let’s work on your project**! Do you have a data project that involves digital twin technology? [I’ll be happy to connect you to one of our experts.](https://linkdigital.com.au/get-in-touch/) - [LinkedIn](https://www.linkedin.com/company/link-digital/%20) - [YouTube](https://%20https://www.youtube.com/@link-digital) - [Facebook](https://www.facebook.com/LinkDigital%20) **Categories:** All articles, Artificial Intelligence, CKAN, Environmental/Climate Change, Government, Open Data, Smart City **Tags:** digital twins, non traditional data sources, smart city technology --- ### [Have a CKAN extension you would like to showcase? This one's for you!](https://linkdigital.com.au/news/2025/03/have-a-ckan-extension-you-would-like-to-showcase-this-ones-for-you/) **Published:** March 4, 2025 **Author:** Andrew Nette **Content:** On this day, the regular monthly CKAN community online meeting will be given over to developers to showcase their extensions via a live demo of their features. **Table of contents** - [What is it about?](#aioseo-what-is-it-about) - [Link Digital and open data](#aioseo-link-digital-and-open-data) - [The CKAN user community](#aioseo-the-ckan-user-community) - [Registration link](#aioseo-we-want-you) ## What is it about? The event is not only designed to showcase [CKAN](https://ckan.org/) as open source software with a global reputation for building open data management solutions, but also how its default functionality can be extended by extensions that add powerful features to performance. Link Digital is proud to support the event, one of many online and in-person events being organised by groups to mark the International Open Data Week (March 1-7), celebrating and encouraging the use of open data. ## Link Digital and open data While Link Digital has always believed in the importance of open data, what is increasingly being referred to as the ‘polycrisis’ – the combination of fast-moving crises such as the COVID pandemic, climate change and the Russian invasion of Ukraine—makes it more important than ever. Open data can play a vital role in helping to solve the polycrisis by enabling researchers and government policy makers to understand the multiple aspects of the crisis and facilitate evidence-based solutions to the interlinked issues that comprise it. Open data can encourage and support collaboration across institutional and geographic divides, improve transparency, accountability, and engender greater civic participation. ## The CKAN user community A key strength of CKAN is its user community, including people drawn from private enterprise, academia and the community sector. Many of these people contribute to the CKAN software’s design and defect correction, including the development of extensions that extend CKAN’s functionality, automate tasks, or allow integration with other tools. There is a wealth of CKAN extensions, and the exact number only grows over time as the community around the software, including specialist digital service providers such as Link Digital, contribute more. These extensions, [some of which were discussed in this article on our site last year](https://linkdigital.com.au/news/2024/10/from-climate-data-catalogues-to-dataset-storage-the-ckan-extensions-that-make-it-possible/), cover everything from data visualisation and data storage improvements to custom theming and metadata standards compliance. ![ckanext-validation](https://linkdigital.com.au/wp-content/uploads/2025/03/img-CKAN-extension-validation-1-1024x230.png)ckanext-validation ## We want you! If you have developed an extension that you would like to get more eyeballs on, the March 19 CKAN Monthly meeting is your chance. You’ll have 5-10 minutes to do a live demo of your extension, its features and benefits to the wider community, as well as connect with other CKAN users and contributors. It doesn’t matter how small the extension is. The only conditions are that it must be open source, have a potential use to the broader CKAN community, and that you provide a link to the repository. If this is something you would like to take part in, we would like to hear from you. [Register your CKAN extension today!](https://docs.google.com/forms/d/e/1FAIpQLSc1ozE5-rFrdRQ-A9WdWv3KIy3p4c4HP7jYDFxAAbeSXGqH_g/viewform) - [Facebook](https://www.facebook.com/LinkDigital) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital) **Categories:** All articles, Open Data, Tutorial **Tags:** CKAN, CKAN extension, Demo day, open data --- ### [Through the lenses of these modern women: International Women’s Month 2025](https://linkdigital.com.au/news/2025/03/through-the-lenses-of-these-modern-women-international-womens-month-2025/) **Published:** March 31, 2025 **Author:** Kate Sampher **Excerpt:** As a child in the 1990s, I saw real progress in the world when it came to how women are seen and treated, which I thought was so positive. But as I got older, I understood that others may have a different story. To mark International Women's Month in March, I wanted to share some stories from the women I work with at Link Digital. **Content:** As a child in the 1990s, I saw real progress in the world when it came to how women are seen and treated, which I thought was so positive. But as I got older, I understood that others may have a different story. To mark International Women’s Month in March, I wanted to share some stories from the women I work with at [Link Digital](https://linkdigital.com.au/). Before I share the stories of my female colleagues, let’s have a look at some of the interesting real-world facts from open data sites worldwide: - [A March 2024 UNESCO fact sheet ](https://www.unesco.org/en/articles/international-womens-day-investment-girls-education-pays#)shows investment in girls’ education has generated huge dividends over the past two decades. Women’s enrolment in higher education has risen dramatically. Globally, about 114 women are enrolled in tertiary education for every 100 men​. - [A United Nations observanc](https://www.un.org/en/observances/equal-pay-day)e notes that women are paid less than men, with the gender pay gap estimated at 20% globally. - In the EU, the [gender pay gap statistic reported](https://ec.europa.eu/eurostat/statistics-explained/index.php?title=Gender_pay_gap_statistics#:~:text=Highlights) that no country has fully eliminated the gender pay gap, the size of which varies across economies. For instance, the gender pay gap in the European Union averages about 12%; in other words, women’s hourly pay is 12% lower than men’s. - [World Health Organization (WHO) report](https://www.who.int/news-room/fact-sheets/detail/violence-against-women#:~:text=,physical%20and%2For%20sexual%20violence%20by) says that **1 in 3 women worldwide (30%)** have been subjected to physical and/or sexual violence in their lifetime. Now let’s hear the stories from the lenses of women from all over the world who work at Link Digital, and why they think International Women’s Month is not just a celebration but a movement. ![Link Digital in participating in the International Women's movement](https://linkdigital.com.au/wp-content/uploads/2025/03/img-womens-month.png)Through the lenses of these modern women: International Women’s Month 2025 ## **Real change starts with small, consistent actions, by Natalia Shemechko and Karina Arro** Karina Arro, Process Coordinator, The Philippines As a woman who’s experienced both the struggles and triumphs of a world still full of barriers for women, whether in my career or in my personal life, I’ve come to realise that real change starts with the small, everyday actions. For me, it’s in the quiet moments, offering a listening ear to a friend in need, speaking up when I see a woman’s voice being ignored, or making sure every woman knows they are capable of achieving anything they set their minds to. I’ve learnt that ending discrimination isn’t about grand gestures but about how we show up for the women around us in the most ordinary yet meaningful ways. It’s in our choices, our conversations, and the example we set every day. No matter how small, every action can inspire change. And if we keep showing up for each other, we’ll build a world where women are empowered to rise together. Natalia Shemechko, Quality Assurance Analyst, Ukraine My call to action is simple: listen, support, and advocate. - Listen to women’s experiences without judgement. Understanding is the first step toward change. - Support women in your life—at work, at home, and in your community—by recognising their contributions and ensuring they have equal opportunities. - Advocate when you see injustice. Speak up against gender stereotypes, challenge unfair treatment, and encourage inclusivity in every space. If we all take responsibility for these small yet impactful actions, we accelerate progress toward a more equal world. ## **Strong and independent women in her life, by Suk Tanganco** Human Resources Manager, The Philippines The women around me are strong, and their strength empowers me to stand up for my own rights. Their resilience inspires me to call out discrimination wherever I see it and to support other women by raising awareness and fostering change. Ending discrimination requires collective effort. By amplifying women’s voices, advocating for fairness, and challenging biases, we can create an environment where every woman has the opportunity to thrive. ## **Facing barriers and biases through empathy, by Anastasiia Shevtsova** UX Designer, Ukraine When I face barriers and biases in both personal and professional spheres, I take them as opportunities to unlock a strength—a superpower that helps me overcome. For me, that strength is empathy. Women are naturally empathetic. It’s a force we’ve carried through generations, shaping families, communities, and industries. Yet, this very strength is often undervalued, dismissed as secondary to logic or strategy. As a designer, I see how empathy shapes not just interactions but entire experiences. In design, empathy is the foundation of innovation and the first step in the design thinking process. Now it is often overlooked, considered less critical than functionality. But what if we recognised empathy as not a soft skill but as a driving force for change? What if we designed not just for usability, but for true understanding? Just as empathy enhances experiences in great designs, it enhances the way we shape society. It transforms how we lead, how we create, and how we shape a future that is more inclusive, thoughtful, and innovative. ## **Recognitions and creating space for women, by Jean Tero** WordPress Consultant, The Philippines In a field where most people expect men to lead, I’ve faced my own share of being overlooked or not taken seriously. As a graduate of IT, I often find myself in situations where people don’t listen to me as much as they do my male colleagues. But I’ve made sure to excel at my work, and in doing so, I’ve gained the knowledge, experience, and respect I deserve. It hasn’t always been easy, but by pushing through and proving myself, I’ve shown that women can excel in these fields just as much as men. I believe it’s important to raise awareness about the challenges women face but also to highlight our achievements and contributions. When I share my story or hear others’ stories, it reminds me that we have the strength and ability to succeed, no matter the obstacles. By talking about both the struggles and successes, I hope to inspire other women in similar positions to keep pushing forward, even when it feels like they’re not being heard. Everyone deserves to be recognised for their hard work, and by supporting one another, we can create a space where more women feel empowered to succeed in male-dominated industries like IT and digital marketing. ## **Small actions matter: a call to end discrimination against women, by Iryna Babenko** Project Manager, Finland In today’s world, we often say that men and women are equal. Yet, deep-seated biases still shape our expectations, opportunities, and treatment.. While men and women are different in many ways, these differences should never justify discrimination. One glaring issue is how leadership styles are judged. A man who is firm and direct is seen as strong, while a woman displaying the same qualities is often labelled as “too emotional” or “too difficult.” It needs to change. Instead of policing women’s behaviour, Why not encourage workplaces to create a more empathetic and balanced leadership for everyone? Supporting women is not just about women; it benefits any gender. Unfortunately, in many places, women are still denied opportunities simply because they are mothers, while fathers face no such scrutiny. In my perspective, this is an unfair double standard that needs to end. Lastly, we must move beyond outdated ideas of “men’s jobs” and “women’s jobs”. A woman can be a firefighter or a mechanical engineer, just as a man can be a nurse or a florist. True equality means giving everyone the freedom to follow their passions without societal judgement. How can we make a difference in ending discrimination? Small actions matter: - Encourage children to explore interests freely, without labelling activities as “for boys” or “for girls.” - Call out sexist remarks or behaviours in conversations, workplaces, and social settings. - Change starts with everyday discussions. - Educate yourself about gender discrimination and how it affects both men and women. Awareness is the first step toward change. - Support equal parenting roles by encouraging men to take paternity leave and be active carers. When caregiving is shared, opportunities for women grow. Ending gender discrimination doesn’t require grand gestures, just everyday choices that promote fairness and respect. Together, through small but meaningful actions, we can build a world where gender is never a barrier to success. ## Listen, act and be part of change I enjoyed reading these points of view. They highlight personal experiences that I thought I was just being too sensitive about and thought were the norm but, in reality, others experience too. They also gave me a wider view of some social issues that I was not aware of because I live in a different part of the world with an entirely different culture. Ending the International Women’s Month with this article doesn’t mean that it’s just a once-a-year movement. I want to end this article with these simple words: Listen, act and be part of change. [**Subscribe to Link Digital** ](https://linkdigital.com.au/newsletter) - [Facebook](https://www.facebook.com/LinkDigital%20) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/%20) **Categories:** All articles, Government, Higher Education/Research, Kate Sampher, Thought Leadership **Tags:** International Women's Month, Thought Leadership --- ### [The challenges of building websites that can speak to everyone](https://linkdigital.com.au/news/2025/05/the-challenges-of-building-websites-that-can-speak-to-everyone/) **Published:** May 6, 2025 **Author:** Andrew Nette **Excerpt:** An interview with Maeva Tesan, Information, Communication and Knowledge Management Officer, Pacific Data Hub and Pacific Community Centre for Ocean Science **Content:** Every data portal faces unique challenges in fulfilling its mission. This is certainly the case with the [Pacific Data Hub](https://pacificdata.org/ "Pacific Data Hub"), an open data portal that serves as a gateway to the most comprehensive data collection relevant to the 22 Pacific Island nations and seeks to make it easily available to as wide an audience as possible, including government decision-makers, Pacific civil society and business organisations, and researchers. ## **Who oversees the Pacific Data Hub** The Hub is overseen by [the Pacific Community (SPC)](https://www.spc.int/ "the Pacific Community (SPC)"), the principal scientific and technical organisation supporting development in the Pacific region. SPC is the custodian of over seven decades of Pacific-related data, including population census, household survey, and geospatial data. In addition to the Pacific states, the Hub also harvests data from the SPC’s metropolitan members and multilateral organisations. The Hub, which began with the assistance of [Link Digital](https://linkdigital.com.au/ "Link Digital") in February 2018, is a crucial data management tool that now hosts close to 800 datasets from across the region. It is also the centre of a growing ecosystem of data products, websites and interactive dashboards, some of which Link Digital has worked on. Those working on the Hub must deal with complex questions around data stewardship and differing levels of data literacy across a geographically and culturally complex region. One is [Information, Communication and Knowledge Management Officer, Maeva Tesan](https://www.linkedin.com/in/maevatesan/?originalSubdomain=nc "Information, Communication and Knowledge Management Officer, Maeva Tesan"). She is responsible for two websites that are connected to – but not directly integrated within – the Pacific Data Hub: [the Climate Change Flagship](https://climatechangeflagship.spc.int/ "the Climate Change Flagship") and the [Pacific Community Centre for Ocean Science (PCCOS)](https://pccos.spc.int/ "Pacific Community Centre for Ocean Science (PCCOS)"). While each serves a different purpose, they are linked through shared goals of improving access to reliable data. In the first two-part series on the Hub’s work, Tesan discussed some of the data management issues and challenges related to her work. ## **A lack of a common data protocol** The Climate Change Flagship website is designed as a comprehensive resource on climate-related issues, covering impacts, adaptation, finance, advocacy, and SPC’s key areas of work in this field. It is also designed, according to Tesan, > as a strategic framework to enhance SPC’s climate change work and a means of gathering all the relevant data in one easy-to-navigate site. For now, she says, > information related to the Climate Change Flagship website is mainly text-based, explaining what climate change is and what SPC is doing in this space regarding climate change projects. It does not gather datasets like the Hub does from external partners. While the site currently focuses on providing explanatory information, it does not yet integrate datasets from external partners, unlike the Pacific Data Hub. This limitation reflects a broader challenge across the region: climate-related data and statistics are often fragmented, incomplete, and dispersed across multiple locations and stakeholders. In contrast, the Pacific Community Centre for Ocean Science (PCCOS) was created at the specific request of SPC’s members, who wanted a central location to host ocean-related science data. This includes a range of related projects aimed at helping decision-makers and communities make more informed decisions about sustainable ocean management and [an ocean catalogue containing detailed scientific data](https://pccos.spc.int/ocean-catalogue "an ocean catalogue containing detailed scientific data"). ![Ocean catalogue - Pacific Data Hub ](https://linkdigital.com.au/wp-content/uploads/2025/05/The-Pacific-Community-Centre-for-Ocean-Science-ocean-catalogue-1024x679.png)The Pacific Community Centre for Ocean Science ocean catalogue > The idea was to have one single webpage where you could access all this data, says Tesan. > When you click on it, you can have access to data produced by SPC or its partners. If there is any project where people are working with SPC and want it to be reflected in the Ocean catalogue, we can easily add it. Before the Ocean Catalogue, anything relating to a topic like ocean circulation was spread across different websites and was hard to find. Only the person who owned the data knew where it was. There are protocols that govern the process of sharing data on the PCCOS. > There needs to be an agreement between SPC and the agencies. There are also different levels of data access. > Only data with clear management and governance protocols can be publicly shared. One central challenge in administering the Climate Change Flagship and PCCOS websites is the lack of a common framework for data sharing and governance throughout the Pacific region. > Every data produced is supposed to be used by every country and every organisation. But SPC doesn’t have the same data governance as the [Secretariat of the Pacific Regional Environmental Program](https://www.sprep.org/ "Secretariat of the Pacific Regional Environmental Program"), the [Forum Fisheries Agency](https://www.ffa.int/ "Forum Fisheries Agency") or the government of Kiribati, etc. In the region, the data sharing agreements differ from organisation to organisation and country to country, depending on their particular data regime and what both parties agree to. There is no common framework or rule for this. According to Tesan, websites like PCCOS are a mechanism for building data capability across the region. > With the Ocean Catalogue, for example, we aimed to adhere to the standardised format and method for sharing heavy datasets, requiring significant data infrastructure and robust servers to host. This remains a complex challenge in the Pacific: when valuable ocean data is developed, sharing it demands significant technical capacity and reliable hosting solutions, which are often limited. ## **Getting data into the hands of those who can use it** Another major issue for Tesan is ensuring that the data hosted on sites such as the Climate Change Flagship and PCCOS websites is not simply sitting there but is being put into the hands of people who can use it. > One of the biggest challenges for me was creating a platform that could truly speak to everyone, says Tesan, referring to the Climate Change Flagship website. > Too often, websites related to science are shaped by the mindset of project managers, usually leaning toward the project management perspective. With the Climate Change Flagship, we tried to find a balance. The website includes technical information on complex topics like mitigation and adaptation, but it’s designed to work for both climate experts, through the climate change dimensions section, and for the wider public, through the projects by country section. Creating a site that speaks to both groups is a big challenge, especially involving scientific data. Clear labelling and naming conventions are important to the solution, so websites can be more easily navigated and understood. Presenting the data visually is another. A successful example of the latter that Tesan is keen to highlight is the Flagship’s [Pacific Climate Change Project’s Map](https://climatechangeflagship.spc.int/pacific-climate-change-projects-map "Pacific Climate Change Project’s Map"). A partnership between SPC and Link Digital, it uses Drupal, a highly flexible open source content management system, to create an interactive map that enables the user to quickly get country-specific data on all climate-related projects underway across the Pacific. ![Image of the Pacific Climate Change Projects Map](https://linkdigital.com.au/wp-content/uploads/2025/05/Pacific-Climate-Change-Projects-Map-1024x563.png)Pacific Climate Change Projects Map > It was easy and quick to create and, even though it has more than a hundred different projects, I think it is quite clear. This map is something that everyone can understand. What was hard was to find the balance between being technical enough for the technical people and good enough for the wider public. Other examples of making information on the Climate Change Flagship website more accessible are its section on Impact Stories—examples of how climate change is being felt and dealt with in the Pacific—and the Publications section, which has downloadable plain-language fact sheets to explain aspects of the SPC’s climate change work. As evidence of their impact, Tesan cites the fact that stakeholders have used these sections of the Flagship site to help inform their policy positions and advocacy during the annual meetings of the United Nations Climate Change Conference. There are plans to include a map of regional ocean projects undertaken by SPC and its stakeholders on the PCCOS site. > If we have new features to contribute to the Climate Change Flagship or the PCCOS websites, I am sure it will be done through dashboards, not just by presenting raw data. > They can help people get data at a glance in a highly visual way. Dashboards are also quite easy to add to the site; we do not have to create any new interface. *[For more information about the Pacific Data Hub, you can check out the case study here.](https://linkdigital.com.au/project/pacific-data-hub/ "For more information about the Pacific Data Hub, you can check out our case study here.")* - [Facebook](https://www.facebook.com/LinkDigital/) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/) **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Geospatial, Government, Higher Education/Research **Tags:** CKAN, climate data, ocean science data, open data, the Pacific Community, The Pacific Data Hub --- ### [What I learned about Climate Data Portals from an expert integrator](https://linkdigital.com.au/news/2025/05/what-i-learned-about-climate-data-portals-from-an-expert-integrator/) **Published:** May 15, 2025 **Author:** Kate Sampher **Content:** - [The role of climate data portals](#aioseo-the-role-of-climate-data-portals) - [Flexibility overcomes rigid solutions](#aioseo-flexibility-overcomes-rigid-solutions) - [The standards dilemma no one talks about](#aioseo-the-standards-dilemma-no-one-talks-about) - [The perfect vs. good enough debate](#aioseo-the-perfect-vs-good-enough-debate) - [Measuring real-world impact](#aioseo-measuring-real-world-impact) - [Extensions that matter](#aioseo-extensions-that-matter) - [Practical insights for climate data portal managers](#aioseo-practical-insights-for-climate-data-portal-managers) ## **The role of climate data portals** Climate data portals have become essential digital infrastructure in a collective response to climate change. I had a conversation with [Lex du Plessis](https://ca.linkedin.com/in/lex-du-plessis-2594458a),the leader behind the implementation of several major open data portals. I’ve come to know him as someone who can clearly express complex thoughts without losing clarity – a rare quality when discussing open data matters that can quickly become abstract. Climate data portals might seem like straightforward repositories of information, but after speaking with Lex, a Technical Delivery Manager at Link Digital who implements [CKAN](https://ckan.org/)-based data portal solutions, it’s evident that they’re far more complex and nuanced than most people realize. For data managers in government agencies and NGOs wrestling with how to build effective climate data infrastructure, here are the most valuable insights from someone who’s in the trenches daily. ## **Flexibility overcomes rigid solutions** The most important advantage of [open-source](https://opensource.org/) platforms like CKAN for climate data is their flexibility. As Lex explained, many proprietary solutions work well for specific use cases but become incredibly expensive when you need to adapt them. > With CKAN, you don’t run into walls where suddenly your organization has to change how it operates to fit the platform’s constraints, Lex noted. This flexibility comes from CKAN’s community-driven nature. Since different organizations have wildly different requirements, the [platform has evolved to accommodate various needs](https://github.com/ckan/ckan/discussions) rather than forcing a one-size-fits-all approach. It’s the architecture that can be customized with extensions to meet specific customer needs. Lex is a very passionate person, and this became evident when he described how [Link Digital](https://linkdigital.com.au/) approaches client projects – focusing not just on technical specifications but also on delivering holistic solutions that genuinely solve their data management challenges. ## **The standards dilemma no one talks about** One of the fascinating aspects of the discussion centered on [standards](https://linkdigital.com.au/news/2025/01/dcat-101-unlocking-the-power-of-data-through-standardisation/) – the hidden framework of effective climate data sharing. When organizations don’t follow common standards, something as simple as harvesting data between portals becomes incredibly complex. Lex gave a surprisingly clear example: > If you don’t know what a ‘house’ is, how can you compare houses? Is it a single room where you sleep? Is it a five-room mansion? When climate data lacks standardization, you waste enormous resources just translating between systems. > Your definition for this metadata field versus my definition – are they the same? Can I say they are equal, or do I need to create a new metadata field to capture what you’re trying to communicate? A real-world example of workflow standardization is [the main Spanish data portal ](https://datos.gob.es/en)that captures data from provincial sources in a hierarchical relationship while also exchanging standardized information with [the European data portal](https://data.europa.eu/en) – creating a seamless flow of climate information across borders. ![Illustration of data workflow for National Data Portals, DCAT, CKAN and multiplatforms.](https://linkdigital.com.au/wp-content/uploads/2025/05/img-CKAN-and-DCAT-webp-scaled-711x1024.webp)[*As shown in episode 6 of Tuesday Talks.*](https://www.youtube.com/watch?v=jInHHuHuX6w) ## **The perfect vs. good enough debate** Perhaps the most thought-provoking insight was about [data quality](https://www.ibm.com/think/topics/data-quality) versus [data availability](https://www.precisely.com/glossary/what-is-data-availability). Many organizations hesitate to publish climate data that doesn’t meet scientific standards. As it’s a constant trade off between volume of published data and it’s quality. Lex described his father-in-law’s simple rain catcher in the garden. It’s not scientifically precise, but if everyone in the neighborhood used one, over time you’d get valuable rainfall patterns for the local area. > You could dismiss it as bad data because it wasn’t captured using specific tools,” Lex said. “But there’s still value in that data. I found this analogy brilliant. It provides a clear mental model for the rather vague concept of data quality, especially when debating whether imperfect data should be published at all. It shifted my thinking from “is this data good enough?” to “how do we properly describe the limitations of this data so others can decide its usefulness?” This raises an important question for climate data managers: Do they withhold imperfect data or publish it with appropriate metadata so users can decide its value? The CKAN community itself debates this, with some arguing the platform isn’t restrictive enough. Lex leans toward publishing. > If you post it, it can be used. If you don’t post it, nobody knows it exists. ## **Measuring real-world impact** How do you know if your climate data portal is making a difference? Lex suggests several approaches: 1. Use [Digital Object Identifiers (DOIs)](https://linkdigital.com.au/news/2020/08/ckan-and-digital-object-identifiers-dois/) – permanent digital identifiers assigned to content, to track citations of your datasets. 2. Monitor site visits and user engagement.Ensure your data is discoverable through services like [Google Dataset Search](https://datasetsearch.research.google.com/). ## **Extensions that matter** When implementing a new portal, Lex relies heavily on community-developed extensions (plug-ins that add specific functionality) rather than reinventing features. > You could reinvent the wheel every time you need a tire, but that’s a lot of work. Three extensions he finds particularly valuable: 1. [Charts extension](https://github.com/DataShades/ckanext-charts) for visualizing time-series climate data.Single sign-on for easier user management. 2. [Data Catalogue Vocabulary (DCAT) extension](https://github.com/ckan/ckanext-dcat), which implements a standard vocabulary for describing datasets, enabling better interoperability. ## **Practical insights for climate data portal managers** After speaking with Lex and reviewing the best practices in data portal implementation, several key insights emerge for organizations managing or launching climate data portals: 1. Prioritize interoperability from the start. Adopt widely-used standards like [DCAT to ensure your data can communicate with other systems.](https://linkdigital.com.au/news/2024/10/enhancing-dcat-support-in-ckan-dcat-ap-v3-scheming-integration-and-more/) This isn’t just a technical consideration,it’s fundamental to your data’s usefulness. 2. Embrace the “publish [proper metadata](https://data.europa.eu/mqa/methodology?locale=[deu:langcode])” philosophy. Rather than withholding imperfect data, focus on providing clear context about data limitations so users can make informed decisions. 3. Leverage community-developed extensions. The open-source community has likely already solved many of your challenges. Use existing extensions before building custom solutions. 4. Implement impact measurement tools early. Set up DOI (​​Digital Object Identifier) assignment, analytics, and discoverability features from the beginning to track how your data is being used. Climate data portals aren’t just technical projects. They’re critical infrastructure for addressing one of humanity’s most pressing challenges. By following these principles, data managers can build systems that not only store information but also meaningfully contribute to climate action. --- Link Digital builds climate data portals based on CKAN. [Send a message today.](https://linkdigital.com.au/get-in-touch/) - [Facebook](https://www.facebook.com/LinkDigital/) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital) **Categories:** All articles, CKAN, DCAT (Data Catalog Vocabulary), Drupal, Environmental/Climate Change, Geospatial, Government, Higher Education/Research, Open Data **Tags:** CKAN, CKAN extension, climate data, climate resilience, DCAT --- ### [More than just a data hub: an interview with Malcolm Fraser, Programme Manager, Pacific Data Hub](https://linkdigital.com.au/news/2025/05/more-than-just-a-data-hub-an-interview-with-malcolm-fraser-programme-manager-pacific-data-hub/) **Published:** May 20, 2025 **Author:** Andrew Nette **Excerpt:** An interview with Malcolm Fraser, Pacific Data Hub Programme Manager, about data stewardship in the Pacific and getting data to those who can use it. **Content:** **Table of Contents** - [The Pacific Data Hub and its governance](#aioseo-the-pacific-data-hub-and-its-governance) - [Collaborative data stewardship](#aioseo-collaborative-data-stewardship) - [Building data capability](#aioseo-building-data-capability) - [CKAN: a vital tool in the Pacific](#aioseo-ckan-a-vital-tool-in-the-pacific) - [Creating a demand for data](#aioseo-creating-a-demand-for-data) ## **The Pacific Data Hub and its governance** The [Pacific Data Hub](https://pacificdata.org/) is the primary hub for data-driven innovation across the Pacific region, fostering a collaborative network where Pacific Island countries and territories, regional organisations, civil society, technical experts and industry professionals all engage as equal partners. Hosted at the [Pacific Community (SPC)](https://www.spc.int/), the region’s principal scientific and technical organisation, it began with the assistance of [Link Digital](https://linkdigital.com.au/) in February 2018 and currently hosts nearly 800 datasets, covering everything from population statistics and fisheries, to gender, human rights, climate change, and oceans. More than just a data portal, the Hub now acts as a system leader for data governance and innovation across the Pacific, catalysing novel data-driven solutions, and fostering an environment where diverse stakeholders co-design and implement impactful initiatives. In the second of a two-part series of interviews with those working behind the scenes at the Hub and its connected sites, I spoke to [Malcolm Fraser, Pacific Data Hub Programme Manager](https://www.linkedin.com/in/malcolmfraser/?originalSubdomain=nz), about the Hub’s evolution, the nature of data stewardship in the Pacific, and the challenges of getting data into the hands of those who can use it. [Part one, an interview with Maeva Tesan, Information, Communication and Knowledge Management Officer with the Pacific Community Centre for Ocean Science and the Climate Change Flagship, can be found here](https://linkdigital.com.au/news/2025/05/the-challenges-of-building-websites-that-can-speak-to-everyone/). ## **Collaborative data stewardship** The Hub has evolved from just being a place to store the data collected by SPC since it was founded in 1947. It now fulfils the role as orchestrator to a regional network of data stewards, innovators and start-ups that embrace experimentation, rapid prototyping, and user-centred design, to create a network of collaborative innovation that adapts to the evolving needs of the Pacific region. Supporting a data-centric, innovative ecosystem, the Hub now provides a resilient and culturally sensitive data infrastructure for the region, ensuring reliable, ethical, and accessible management of diverse datasets wherever they reside. From this infrastructure, the Hub’s data is actively used to create a range of connected products – such as websites and dashboards – often developed in direct response to member requests. In doing so, the Hub has become a vital mechanism for building data capability and fostering a uniquely Pacific approach to data stewardship. Fraser contends that solely focusing on the stages that inform a decision to add another dataset, site or dashboard to the Hub, my initial question to him, misses a broader point. > What is important is the ability to step back and think about the outcome for the Pacific at the front end of the conversation and leave the technology conversation to the back end of the project concerned. The focus is still on using data, ensuring data quality and appropriate governance standards, and finding opportunities to do things with the data so it can help solve problems and inform better decision making. But the Hub leans into a different, more cooperative approach in which the data steward’s job > is to be the honest broker in those collaborations. According to Fraser, the central idea is that > traditional hierarchical governance models often struggle to address complex, cross-sectoral challenges, especially in diverse and dynamic regional contexts like the Pacific. As such, we view data stewardship as the process of bringing together diverse stakeholders to prototype innovative data solutions that address pressing regional challenges such as climate resilience, health surveillance, and sustainable fisheries. In this mode, an MoU or a data-sharing agreement is a tool that sits alongside a marine special planning tool. It’s not the starting point for an innovative collaboration. Fraser estimates that 80 per cent of the project cycle for a Hub initiative involves these kinds of collaborative discussions before any consideration of technology takes place. > And in that process, we can help assess both data governance and innovation maturity levels, alongside the establishment of standards, policies, and best practices for ethical and innovate data stewardship, sovereignty, privacy, and interoperability across the Pacific. ## **Building data capability** The differing levels of data capability or literacy in the Pacific, a topic that often comes up in relation to the Hub, is a complex issue that Fraser argues needs to be properly framed. > The Pacific region generally lags behind other regions like North America and Europe in data literacy maturity, facing challenges in data governance, centralisation, and advanced data skills despite improvements in foundational literacy through initiatives like the [Pacific Island Literacy and Numeracy Assessment](https://pilna.eqap.spc.int/). And yet, if you talk about data involving tuna fisheries and tuna fisheries management, we have the world’s best scientists and datasets related to this. The data literacy in those areas is extremely high. If you go down to the community level, you’ll have a different level of literacy… And that’s the thing about the Pacific, it’s diverse. To help address these issues, the Hub works closely with an independent and growing network of Pacific data stewards, known as the [Pacific Data Steward Network](https://www.linkedin.com/groups/13960246/), as well as working with SPC divisions to help apply the principles of data governance to build a common framework for managing data for the good of the Pacific. > The idea of collaborative data governance is what brings all this together. If you have disparate dashboards or datasets, etc, we have the Data Governance and Innovation Framework (DGIF) to bring them in. With DGIF, we can ensure a structured yet flexible approach to managing the complexity of data initiatives by separating concerns into discovery, definition, and two parallel iterative tracks focused on governance and innovation, enabling continuous learning and adaptation throughout the design journey that move from the opportunity or need, all the way down the data infrastructures. Using this approach with DGIF, we can focus on scaling, deploying, and optimising data-driven solutions to maximise their impact, by launching solutions into production, monitoring their performance and user adoption, iterating based on feedback, and integrating them with existing systems across the region to deliver measurable impact. ![](https://linkdigital.com.au/wp-content/uploads/2025/05/img-PDH-mockups-1024x763.webp)[Pacific Data Hub](https://pacificdata.org/) ## **CKAN: a vital tool in the Pacific** The Hub’s technical implementation combines both [CKAN – the Comprehensive Knowledge Archive Network](https://ckan.org/) – and [Drupal](https://new.drupal.org/home) platforms, seamlessly integrated into a unified solution that leverages the strengths of both systems. > The thing that keeps it together is CKAN, in terms of the metadata management, Fraser notes. > Whatever comes in, is entered into CKAN to establish clear metadata. In the Pacific context, CKAN plays an important role not just in terms of organising data, but when the communities it is collected from want it back. > The repatriation of data is an emerging topic on the landscape, whether it is the Pacific Data Hub or someone else that has it. If data is repatriated back to where it came from, the metadata in CKAN is no longer pointing into the Pacific Data Hub anymore, rather it now points to where that data sits. This way it’s still searchable, whether it resides in an on-premises SPC server in Noumea, in the SPC cloud, or on a server in the Solomon Islands government. Whatever the case, users can come to the Hub and through the metadata, can see where this data might be and who they might need to contact to ask permission to access it. ## **Creating a demand for data** How to create demand for the Hub’s data and get it to people who can activate its potential, is constantly on Fraser’s mind. > Data has no value sitting on a hard drive. It has plenty of value when it is being moved around and helping to do things like informing decision-making. So, it is all about empowering people to get their hands on it. Making the data more accessible and presenting it in such a way as to enable people to tell stories with it, is key. And, again, a collaborative approach is vital. > The really good stories come when you are actually pulling multiple perspectives of a situation, Fraser says. > It’s about building the capability in the Pacific, so it’s the Pacific that’s taking it out there and they are having those conversations, and they are putting their stories from their different countries around that data. For example, the [Pacific Dataviz Challenge](https://pacificdatavizchallenge.org/) is an annual competition supported by the Hub and [New Zealand’s Ministry of Foreign Affairs and Trade](https://www.mfat.govt.nz/), designed to inspire creative and impactful data visualizations that communicate complex Pacific data in accessible and engaging ways. Together with higher education partners and the Pacific Data Steward Network, the Dataviz Challenge encourages local talent, data scientists, and developers to harness the rich datasets hosted by the Pacific Data Hub and its partners, to tell stories that inform policy, raise awareness, and empower local communities. - [Facebook](https://www.facebook.com/LinkDigital/) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/) **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Government, Higher Education/Research, Open Data **Tags:** CKAN, collaborative data governance, data stewardship, Pacific Community, Pacific Data Hub --- ### [Enhancing data visualisation: implementing a customised graphing extension for the Columbia Basin Water Hub](https://linkdigital.com.au/news/2024/10/enhancing-data-visualisation-implementing-a-customised-graphing-extension-for-the-columbia-basin-water-hub/) **Published:** May 21, 2025 **Author:** Andrew Nette **Excerpt:** This post will discuss the extension, the collaboration process behind its development, and how it has enhanced the Water Hub’s visual presentation of data and improved how contributors and users interact with it. **Content:** **Table of contents** - [The Columbia Basin Water Hub](#aioseo-the-columbia-basin-water-hub) - [Why was enhanced data visualisation necessary?](#aioseo-why-was-enhanced-data-visualisation-necessary) - [Benefits of the new graphing extension](#aioseo-benefits-of-the-new-graphing-extension) - [Challenges in developing the graphing extension](#aioseo-challenges-in-developing-the-graphing-extension) - [Link Digital working to make water data more usable and shareable](#aioseo-link-digital-working-to-make-water-data-more-usable-and-shareable) - [Interested in better data visualisation?](#aioseo-interested-in-better-data-visualisation) One of the things [Link Digital](https://linkdigital.com.au/) is proud of is our ongoing collaboration with clients to improve or build on data management solutions we have developed together. A recent example is work with [Living Lakes Canada](https://livinglakescanada.ca/) on their [Columbia Basin Water Hub](https://data.cbwaterhub.ca/), an [award winning](https://data.cbwaterhub.ca/) example of how open data can contribute to environmental conservation, freshwater stewardship, and community empowerment. Following the launch of the Water Hub, Link Digital joined the team to support the ongoing development of the site. Link Digital worked with the organisation to develop and implement a customised extension to improve the Water Hub’s data visualisation capabilities. This article will discuss the CKAN extension, the collaboration process behind its development, and how it has enhanced the Water Hub’s visual presentation of data and improved how contributors and users interact with it. ## **The Columbia Basin Water Hub** Living Lakes Canada is a charitable water stewardship non-government organisation with over 20 years of experience working with community groups to protect freshwater. Their activities range from groundwater, lake, stream, and wetland monitoring to foreshore health assessments, biomonitoring for aquatic assessment and restoration, and water database development and management. The Columbia Basin Water Hub is their open data portal for freshwater data within the Columbia Basin, North America’s fourth largest freshwater basin. The Water Hub was developed in response to the desire for a more coordinated water monitoring effort in the region, including the need to plug significant gaps in water data. Many local groups conduct water monitoring in the Basin, and their information was being held on private devices and, in some cases, even on paper, and was at risk of being lost. The Water Hub is designed to improve collaboration by helping the various stakeholders store and manage their data appropriately and effectively and make it freely accessible and usable. Launched in March 2021, the Water Hub incorporates a [CKAN](https://ckan.org/) instance, and includes customised features such as enhanced access and controls to maximise data sovereignty and adhere to [OCAP®](https://fnigc.ca/ocap-training/) (Ownership, Control, Access, Possession) principles. It supports images and videos as dataset resources, and metadata schema and user experience enhancement are configured to optimize data discoverability and access. ## **Why was enhanced data visualisation necessary?** Link Digital has since been involved in ongoing support and maintenance of the Water Hub. One of the issues flagged by Living Lakes during this time were problems with the existing out-of-the-box CKAN graphing tool, particularly when it comes to showing data based on dates. > This makes the data hard to understand, said [Lex du Plessis](https://www.linkedin.com/in/lex-du-plessis-2594458a/?originalSubdomain=ca "Lex du Plessis"), Link Digital’s Technical Delivery Manager. > Other feedback was that any time somebody starts working with the data to visualise something in a graph form, they find it is easier to download the dataset and do it in Excel, undertake whatever graphing work they need to, take screenshots of this and then reload these into CKAN, because it was just too hard to do a good graph in CKAN. The need to be able to upload and showcase data in one space was the impetus behind developing a customised graphing extension. The ability to make water-related data viewable in visual formats also makes it easier to digest and enables users to draw quicker insights, including long-term trends and patterns which, in turn, enhances decision making regarding fresh water management. It can also enable more effective stakeholder communication and collaboration by making real time water-related data more accessible to a wider range of groups. > At first we tried to reconfigure the existing out of the box CKAN graphing tool, said du Plessis. > But when this didn’t work and we realised the existing tool was basically not fit for purpose, we decided to reinvent it. We developed an entirely new extension, *ckanext-charts*, now being used in the Hub. ## **Benefits of the new graphing extension** The extension enables users to easily generate interactive and visually appealing charts to enhance data analysis and presentation, by allowing them to create, manage, and visualize data stored in CKAN datasets. ![](https://linkdigital.com.au/wp-content/uploads/2024/10/In-this-on-Im-showing-how-the-water-level-discharge-and-water-temperature-changes-over-time.png)*Displaying how changes to water level, discharge and temperature can be displayed simultaneously over time.* Let’s take an example relevant to the Water Hub: water level, discharge and temperature over time for a dam. With the extension, a user can show all three as a graph. It also enables a user to zoom in on a particular time span and track it in granular detail. For example, if a user wants to focus in on two years of a large span of data for the dam, they overlay the two years across one another, with a red line tracking one year and a blue line tracking the other. ![](https://linkdigital.com.au/wp-content/uploads/2024/10/Image-2.png)*The zoom functionality of the extension allows a user to to focus on data from a specific time period.* The extension also enables users to: - Flip the axis of a graph to view the data in a different way. - Present the data in different visual styles, such as a pie, bar or line chart. - Embed a graph in a description of the dataset, to showcase it and make it more impactful. - Set permission controls, so that the use of the extension could be restricted to only authenticated users. The extension makes the Water Hub more interactive in the way it handles data. > It also has a very powerful backend, which means we have kind of future-proofed it a bit, said du Plessis. > You can choose between three different plotting engines \[the software component responsible for rendering or displaying graphic representations of data\] and if one of the engines becomes deprecated, we can just slot another one in. > The new graphing tool has the potential to significantly enhance how our contributors and users interact with the Columbia Basin Water Hub, said [Maggie Finkle-Aucoin](https://livinglakescanada.ca/profile/team/maggie-finkle-aucoin/ "Maggie Finkle-Aucoin"), GIS and Database Manager at Living Lakes Canada. > By providing access to improved visualization functions, users can better understand the data they collect and spot trends more easily. This is crucial not only for scientific analysis but also for communicating insights to broader audiences, including those without a scientific background. Visualizing data helps bridge the gap between raw information and meaningful narratives, making it a powerful tool for community engagement and decision-making. ## **Challenges in developing the graphing extension** The conversation with Living Lakes about their graphing data needs took about a year, followed by the actual product development which went for close to three months. During this conversation, Link Digital strove to understand the data that the tool needed to graph. For example, the water data was in different formats, because of the various ways the Water Hub collected it. > We had to make sure we understood all of them, and that the graphing tool could adapt to any data format, and that meant really understanding the data we are working with and being able to plot it. It was also important that we built the tool in such a way that it is flexible enough to do other things. It is very easy to build a tool that shows one graph. It is very hard to build a tool to show twenty graphs well. It is about making sure that your tool is not a one trick pony. > We’ve always found working with Link Digital to be a positive experience, said Finkle-Aucoin. > Lex, our product owner over the past year, has consistently taken the time to understand our needs and work with us to develop solutions that best serve our community. I was especially impressed with how Link Digital integrated a year’s worth of discussions and insights into the development of the graphing tool. It showed a holistic approach to our platform, rather than a generic ‘one size fits all’ solution, which is crucial for addressing the specific needs of our users. The graphing extension also comes with comprehensive documentation and support, to make it as easy to use as possible. ## **Link Digital working to make water data more usable and shareable** Link Digital’s custom designed [*ckanext-charts* extension](https://github.com/DataShades/ckanext-charts) enables users to generate interactive and visually attractive charts from data they have collected. In the case of Columbia Basin Water Hub, this enables users to better understand the data they collect and spot trends more easily, making it a more effective tool for building community engagement and enabling better decision-making. There is now considerable interest in the graphing extension from other organisations in Canada and elsewhere. Read the case study: [Columbia Basin Water Hub](https://linkdigital.com.au/project/columbia-basin-water-hub/) ## **Interested in better data visualisation?** Are you interested in making your data more interactive and visually appealing? If so, [contact us](https://linkdigital.com.au/get-in-touch/ "contact us") and tell us about your project. **Categories:** All articles, CKAN, Environmental/Climate Change, Higher Education/Research, Open Data **Tags:** CKAN, Columbia Basin Water Hub, Data visualisation, Link Digital, Living Lakes Cambodia, water data management --- ### [Introducing Pre-built CKAN delivered by Link Digital On AWS Marketplace](https://linkdigital.com.au/news/2019/09/introducing-pre-built-ckan-delivered-by-link-digital-on-aws-marketplace/) **Published:** May 28, 2025 **Author:** Steven De Costa **Excerpt:** Are you thinking of using CKAN to publish your data but have no idea how the tool works?  Familiar with CKAN but don’t have adequate knowledge to install it yourself? Link Digital might have a solution for you. **Content:** #### **Are you thinking of using CKAN to publish your data but have no idea how the tool works? Familiar with CKAN but don’t have adequate knowledge to install it yourself? Link Digital might have a solution for you.** [CKAN](https://linkdigital.com.au/ckan/) is an open-source data management system (DMS) commonly used by government institutions, organisations and other open data players to manage and publish their data. With CKAN, users can easily access, search and view data in different forms including graphs, tables, maps, etc. No matter how great a tool, not everyone has sufficient knowledge and capabilities to maximise this open-source DMS. Sure, there are a lot of companies like [Link Digital](https://www.linkdigital.com.au/get-in-touch) offering CKAN hosting and management, but what if you only have a small amount of data to provide and are wondering if CKAN fits your requirement? Gladly, Link Digital (known for its various [open data initiative including Datashades.info](https://linkdigital.com.au/news/2019/10/introducing-datashades/)) configured pre-built versions of CKAN instances. These instances are available on AWS Marketplace which you can install by only paying for the AWS Instance. In addition, should the traffic to your CKAN portal outgrows what a single instance can handle, you can opt to upgrade any time by getting in touch with the Link Digital team. ## CKAN by Link Digital Link Digital CKAN is a pre-configured, ready-to-run image for running CKAN on Amazon EC2. This pre-built CKAN created by the Link Digital team makes it easier for anyone to use the aforementioned data management tool even if you have little or no knowledge about it. ## CKAN delivered by Link Digital is suited for: - People without prior knowledge but want to try to use CKAN - People looking for a starting point to use CKAN cheaply - People with small amount of data - People who are curious whether CKAN fits their requirements Currently, the Link Digital team has configured a[ pre-setup Link Digital CKAN instance](https://aws.amazon.com/marketplace/pp/prodview-q7axjeawoutck?sr=0-3&ref_=beagle&applicationId=AWSMPContessa) available for anyone with an AWS account. ## More instructions For instructions on how to update CKAN to the latest minor version, check out: If you are unable to follow the instructions or you need further help in upgrading your instances for more complex environments, talk with one of our CKAN experts today or visit [www.linkdigital.com.au/get-in-touch](https://www.linkdigital.com.au/get-in-touch). **Categories:** All articles, CKAN, Government, Higher Education/Research, Open Data, Steven De Costa, Thought Leadership, Tutorial **Tags:** AWS, CKAN hosting, Cloud computing --- ### [Public governance in a time of polycrisis: what I learnt from Berlin’s Creative Bureaucracy Festival](https://linkdigital.com.au/news/2025/06/public-governance-in-a-time-of-polycrisis-what-i-learnt-from-berlins-creative-bureaucracy-festival/) **Published:** June 24, 2025 **Author:** Andrew Nette **Excerpt:** How can the public sector and those working for it be more effective in what many increasingly refer to as a time of polycrisis? Read also: public governance. **Content:** The Festival, the eighth to take place so far, brought together public administrators from Germany and across Europe, and as far afield as Australia, New Zealand and the United States, along representatives from universities and other large public sector bodies. Understandably, much of the meat of the event took place in the large German language component of the program. But, for non-German language speakers, there were still plenty of sessions to attend. Those I attended offered up several common themes, foremost being the massive pressures facing European governments to improve data and digital driven services. ![Public Service Modernization and Digitization](https://linkdigital.com.au/wp-content/uploads/2025/06/European-countries-take-on-modernisation-and-digitisation-1024x535.jpg)*Image created by Anastasiia Shevtsova, UX Designer at Link Digital* ## Public administration and the polycrisis The theme that most tied the day-long event together for me was the challenges facing the public sector and those working for it, from what several conference speakers referred to as a time of *polycrisis*. First used in a 1993 book by French philosopher and sociologist Edgar Morin, the term has become an increasingly popular shorthand to describe not just the existence of multiple major crises but how these interact and reinforce each other: climate change, war, economic instability and poverty, and growing transnational migration. One of the most obvious manifestations of the polycrisis at present is the second Trump Presidency. An administration intent on pulling back from productive engagement abroad, while rapidly dismantling public administration at home. “Polycrisis is not the word for what is happening in the US government right now,” stated one American public servant at the event. “It’s just crisis and chaos.” The challenges of being a public servant amid the dismantling of public administration, including much of America’s science and research capacity, and the wholesale removal of vast swathes of government data, have been analysed at length in the media. Less commented on is the fact that the Trump administration’s actions have trickled down to state and even local governments, causing widespread public administration paralysis. The rise of what might be termed anti-government governments is also occurring outside of the US, for example, in Argentina where far right popularist Janier Milei has embarked on a brutal Trump style diminution of that country’s public sector’s capability. ## The challenges facing Europe Public administration in Europe is facing multiple crises: the political and economic shockwaves caused by the ongoing conflict in Ukraine, and the rise of authoritarian political forces antithetical to the European Union (EU). These threaten not just the EU’s future viability as a political union but also its role as a key source of much of Europe’s laws and regulation. As one senior EU representative put it: “Across high income European countries, trust in economic systems is faltering, especially for young people, with a flow on effect for how these people view institutions like government.” ## Building trust through data The challenges inherent in this situation were on display in a session titled[ ‘](https://creativebureaucracy.org/programme/building-trust-public-administration-times-european-challenges)[Building Trust](https://creativebureaucracy.org/programme/building-trust-public-administration-times-european-challenges)[ in Public Administration in Times of European Challenges’](https://creativebureaucracy.org/programme/building-trust-public-administration-times-european-challenges) featuring senior bureaucrats in the data and digital space from Finland, France, and Germany. All agreed that declining levels of trust in government across much of Europe has put public administrators under intense pressure to prove themselves to citizens. One part of the solution is that European governments are seeking to rapidly digitise their public administration and service provision. At the same time, however, they face significant public spending curbs, largely due to the US pull back from the region, which has seen a shift in defensive planning from crisis management – the main role of European armies since WWII – to a more assertive posture, with a corresponding move in budgetary priorities. ![Digital policies and digital identifications](https://linkdigital.com.au/wp-content/uploads/2025/06/img-European-countries-take-on-modernisation-and-digitisation-1024x535.webp)*Image created by Anastasiia Shevtsova, UX Designer at Link Digital* ## European countries embrace digital modernisation According to [Magdalena Zadara](https://www.linkedin.com/in/magdalena-zadara-a8a97153/), Chief of Staff and Strategy for [Digital Services Germany](https://digitalservice.bund.de/en) (DSG), state modernisation is a key priority of the coalition government elected earlier this year. DSG is what in Europe is referred to as an internal consulting company, government bodies that support the implementation and delivery of public policies, often acting as an arm’s length broker between government and the private sector. DSG is currently tasked with developing digital applications to move the country’s administration away from its reliance on manual document based procedures, which are viewed as a key contributor to fragmented and sometimes poor service outcomes. Finland’s efforts to rapidly digitise services face several challenges. “How do you adapt to rapid change when everything is built on democracies that are not moving quickly?” said [Kirsi Aaltola](https://www.linkedin.com/in/kirsi-aaltola-10a33122/), a senior manager at the [Finnish Institute of Public Management Ltd](https://haus.fi/en/front-page/). “The need for agility can clash with the need to reach for consensus that is not necessarily there.” In Finland, as elsewhere across Europe, there are also fewer public servants to do the work, a trend which will only grow as birth rates go down. The French Government is also undertaking an ambitious programme of service digitisation. [Clio Lardenois](https://www.linkedin.com/in/clio-lardenois-71355b4/), a senior manager in the [Interministerial Directorate for Public Transformation](https://www.modernisation.gouv.fr/), stated the focus has to be not only on digitising bureaucracy but doing so in a way that makes service provision less complex for citizens. This sentiment was amplified by Zadara: “There is no point in just digitising a service that already doesn’t work. You have to make the service better.” Among the strategies being considered by European governments to facilitate rapid digitisation, is a focus on standardised digital products, based in part on what has worked elsewhere, and partnering or bundling with other national administrations and the EU to procure them. Digital services do not have to start from scratch, noted Zadara. “If something exists on the market, use that.” In this respect, some of the speakers drew a direct comparison to the situation in the Ukraine, where the government doesn’t have twenty years to build defense solutions but must do it now with the technology at hand. ## The role of data: shifting but still central That open data is under threat was highlighted by several speakers at the conference, particularly in the context of advances in AI. Nonetheless, as was evidenced from several of the sessions, the central role of data in modern public administration remains, as do the challenges of how to better store, share and extract value from it. A session titled [‘](https://creativebureaucracy.org/programme/transforming-innovative-public-procurement-focus-impact-and-data)[Transforming Innovative Public Procurement](https://creativebureaucracy.org/programme/transforming-innovative-public-procurement-focus-impact-and-data)[’](https://creativebureaucracy.org/programme/transforming-innovative-public-procurement-focus-impact-and-data) saw an interesting debate on how data could be used more effectively to improve public procurement policies, which account for between 14 to 20 percent of GDP in the EU, depending on the sources. Many believe that European governments are adopting a siloed, inflexible approach in this area, rather than putting data at the centre. “This is an area in which European governments are swimming in data,” said one speaker, “but they don’t know how to use it.” ## The take up of digital identification One of the most contentious areas of European data and digital policy reform is digital ID. Germany’s new coalition government has pledged to expand the current digital ID system – called eID – as well as increase the use of biometric surveillance for security purposes. Other EU countries are mulling similar measures. While the number of Germans who use the basic eID system is growing, the question of how to provide citizens with a way to make verifiable claims on government while providing a minimum of personal data, in a way that protects people’s freedoms and their data, remains the subject of considerable debate. One of the most interesting sessions I attended, [‘](https://creativebureaucracy.org/programme/digital-identities-asia-gate-opener-modern-administration)[Digital Identities in Asia – Gate Opener to a Modern Administration](https://creativebureaucracy.org/programme/digital-identities-asia-gate-opener-modern-administration)[‘](https://creativebureaucracy.org/programme/digital-identities-asia-gate-opener-modern-administration), was a roundtable featuring the experiences of three Asian nations that are implementing digital systems to help citizens connect and verify the ID requirements to access services: ## Digital ID in India, Taiwan and South Korea India’s system, known as Aadhaar, uses a 12-digit unique identity number that can be obtained voluntarily by all residents of India, based on their biometrics and demographic data. A mixture of open source and proprietary tech, approximately 90 per cent of the country’s 1.4 billion citizens now use Aadhaar in their interactions with everything from social welfare services and university entrance to employment and taxation. Launched in March 2025 and now being rolled out across the county, Taiwan utilises a system known as the Taiwan Digital Identity Wallet, which allows users to securely store their digital credentials such as citizen digital certificates, national health insurance cards, driver’s licences and more. South Korea uses a digital ID card that allows citizens to securely store and utilise digital versions of their official identification cards on their smartphones, and reveal only the data necessary for a particular interaction, Although the three systems are different, the debate following the presentations revealed similarities around the implementation. There must be a strong focus on privacy and security, including stringent conditions on who can access the data. Presenters from all three countries stressed that governments must take the time not only to get the technology right but also to establish the use case for why citizens should support it. The need to retain physical verification parallel with digital ID services was also seen as vital. ## Nothing changes and then everything changes My last session for the day was titled [‘Governing the Unknown: Public Innovation and Leadership in Uncertain Times.’](https://creativebureaucracy.org/programme/governing-unknown-public-innovation-and-leadership-uncertain-times) [Juan Felipe López Egaña](https://creativebureaucracy.org/foundation/people/juan-felipe-lopez-egana), the founder of a change agency called Unit in Santiago, Chile, outlined three potential avenues of action open to public servants in Latin America to make themselves relevant to the communities: go with the status quo, go with the dominant political flow in the country concerned, or attempt public innovation. While the status quo is no longer a viable option, going with the flow has serious risks, and public innovation costs money and is slow. These challenges were summarised even more forcefully by [Marco Steinburg](https://www.linkedin.com/in/marcosteinberg/), the founder and CEO of [Snowcone & Haystack](https://snowcone.fi/), a strategic design consultancy focused on public sector innovation: “The option to tinker is not viable anymore. We have had a period in which the status quo has dominated and inertia often wins. This period is over. We have no choice but to go for big change and move quickly.” --- Link Digital supports the open data movement. The team at Link Digital builds open data portals for governments, non-profits, academics, and research organisations. [Reach out today](http://linkdigital.com.au/get-in-touch) to learn more. - [Facebook](https://www.facebook.com/LinkDigital) - [YouTube](https://www.youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/) **Categories:** All articles, Artificial Intelligence, Environmental/Climate Change, Government, Higher Education/Research, Non-profit/NGO, Open Data **Tags:** Creative Bureaucracy Festival 2025, digitisation, polycrisis, public sector governance --- ### [Artificial intelligence and open data – a mutually beneficial interaction](https://linkdigital.com.au/news/2025/01/artificial-intelligence-and-open-data-a-mutually-beneficial-interaction/) **Published:** June 27, 2025 **Author:** Andrew Nette **Excerpt:** One emerging discussion that Link Digital is keen to highlight concerns the proposition that the intersection between AI and open data involves far more than open data’s role as raw material to train and operate large machine learning models, the focus of so much of the commentary to date. **Content:** One emerging discussion that Link Digital is keen to highlight concerns the proposition that the intersection between the two involves far more than open data’s role as raw material to train and operate large machine learning models, the focus of so much of the commentary to date. - [The relationship between open data and AI](#aioseo-the-relationship-between-open-data-and-ai) - [How can AI benefit open data?](#aioseo-how-can-ai-benefit-open-data) - [Conclusion](#aioseo-conclusion) - [Want to talk more about how you can unlock the power of your open data?](#aioseo-want-to-talk-more-about-how-you-can-unlock-the-power-of-your-open-data) In addition to surveying some of the public policy benefits that can result from AI and open data working together, the following post will look beyond how open data benefits AI and examine what AI can potentially contribute to open data. ## **The relationship between open data and AI** The [Open Knowledge Foundation defines open data](https://opendefinition.org/) as data that ‘anyone can freely access, use, modify, and share \[the data\] for any purpose (subject, at most, to requirements that preserve provenance and openness).’ Open data is generally thought to benefit AI by providing usable training data. [As a July 2024 report by the European Union (EU) put it](https://data.europa.eu/en/news-events/news/role-artificial-intelligence-open-data-legal-and-policy-challenges): The transformative potential of AI originates from its ability to analyse data at scale, and to notice and internalise patterns and correlations in that data that humans (or fully deterministic algorithms) would struggle to identify. In simpler terms: modern AIs flourish especially if they can be trained on large volumes of data and when they are used in relation to large volumes of data. There is considerable evidence that AI, combined with open data, is reshaping how the public sector works, helping to drive improved policy insights and formulation. AI can quickly synthesize large amounts of open data to detect patterns and trends that might otherwise not have been discoverable, enabling policy makers to come to more focused and timely decisions and combine data across disciplines to derive new insights. This, in turn, offers the promise of a more holistic approach to decision making that can span or break down silos. [Writing on the Spanish Government’s open data portal, *Datos.gob.es*](https://datos.gob.es/en/blog/combining-benefits-open-data-and-artificial-intelligence), [the World Wide Web Foundation’s senior researcher Carlos Iglesias](https://www.opengovpartnership.org/people/carlos-iglesias/) argues that the synergy of open data and AI can go a step further and help facilitate more collaborative data analysis. Through this process, multiple stakeholders can work together on complex problems and find answers through open data. This would also lead to increased collaboration among researchers, policymakers, and civil society communities in harnessing the full potential of open data to address social challenges. Additionally, this type of collaborative analysis would contribute to improving transparency and inclusivity in decision-making processes. ![Illustration: The relationship between AI, open data, citizens and policy makers.](https://linkdigital.com.au/wp-content/uploads/2025/01/img-AI-OD-farmers-policymakers-1024x535.jpg) In agriculture, for example, [Rutgers University Policy Lab](https://policylab.rutgers.edu/artificial-intelligence-and-open-data-for-public-good-implications-for-public-policy/?utm_source=chatgpt.com) states that the use of AI and open data to collect and analyse large amounts of data is helping farmers and related policy makers to analyse soil sample conditions and weather patterns. ‘AI tools and applications also help in managing logistics and making optimal business decisions, including identification of crop sequences for profit maximization contextualized to external variables.’ The EU report cited previously notes that combining data on weather, seed genetics, soil characteristics, and environmental conditions has the potential to train AI to deliver important insights on the factors affecting agricultural production across Europe. ‘Such a system could be used to aid decision-making to increase crop yields, prevent plant disease, or optimize other business decisions.’ Other examples [discussed in this article on the EU’s open data portal, *data.europa.eu*](https://data.europa.eu/en/publications/datastories/open-data-and-ai-symbiotic-relationship-progress?utm_source=chatgpt.com), include combining open data on climate and energy with AI to [develop an app](https://data.europa.eu/en/news-events/news/eu-datathon-2022-teams-behind-apps-meet-croz-reneuwable) to provide citizens with recommendations for more sustainable decisions on energy in Croatia, and the way in which the European Union’s [European Cancer Imaging Initiative](https://digital-strategy.ec.europa.eu/en/policies/cancer-imaging) has used large open datasets and AI to battle cancer. ![How can AI benefit open data? The three critical factors](https://linkdigital.com.au/wp-content/uploads/2025/01/img-AI-benefit-OD-1024x535.jpg) ## **How can AI benefit open data?** The EU report lists three critical factors in relation to data that are necessary for AI to function effectively and equitably: data volume; data variety, i.e., diverse data sources to enhance AI’s ability to perform better in real world scenarios and avoid bias; and data veracity, in other words, data that is high quality and accurate. The EU report notes that the volume and variety factors have to some extent been satisfied by the breadth of open data available to AI to date. It contends, however, that data quality, ‘a priority to unlock the synergy between open data and AI,’ requires a more deliberately focused effort. A similar sentiment, that high-quality data is essential for a more equitable and efficient AI, was expressed in [this post](https://linkdigital.com.au/news/2023/09/good-data-for-artificial-intelligence-what-does-it-mean-and-how-can-we-get-it/). The intersection of AI and data quality is so crucial that the public sector data think tank [Gov Lab](https://thegovlab.org/) [argued in a report last year that it potentially holds the key to what it terms the ‘Fourth Wave of Open Data.’](https://arxiv.org/abs/2405.04333) The [Third Wave of Open Data](https://opendatapolicylab.org/third-wave-of-open-data/) involved the proposition that the open data ecosystem had moved beyond focusing on simplifying data and its impacts, to how governments, private corporations and civil society organisations can better know and understand the data they have and share it to provide improved products and services, and a more informed citizenry. Gov Lab describes the Fourth Wave as ‘the next frontier of open data where open data is more conversational and AI ready, data quality and provenance are centre stage, a whole range of new use cases from open data are feasible and there are new avenues of data collaboration.’ As part of this, Gov Lab asserts it is in the interests of AI developers to focus more on the quality requirements of open data, a process that could also potentially address many of the pain points in open data access and usage. According to Gov Lab this could include: - Enhancing transparency and documentation, which could help users better evaluate data lineage, quality and impact. - Increasing the focus on data quality and integrity, including AI playing a role in data cleaning and preparation, and identifying and correcting errors and filling gaps. There is also a role for AI in promoting interoperability and consistent data and metadata standards to enable more efficient and effective data re-use. Iglesias notes that this work could also involve ‘the development of common data standards, metadata frameworks, and APIs to facilitate the integration of open data with AI technologies, further expanding the possibilities of automating the combination of data from diverse sources.’ Some even argue that open data’s centrality to AI is a powerful argument not only for governments to focus on creating better open data infrastructure and policies to prioritise data quality, discoverability and useability, but to make more government data, particularly high value datasets, more open. [As Open Data Institute framed it in a June 2020 blog post](https://theodi.org/news-and-events/blog/policy-intervention-4-ensuring-broad-access-to-data-for-training-ai-models/), this could be essential to heading off what some term a looming [‘data winter.’](https://sverhulst.medium.com/are-we-entering-a-data-winter-f654eb8e8663#:~:text=Indeed%2C%20unless%20we%20step%20up,are%20instead%20frozen%20and%20immobilized) The result of both the drying up of open datasets to train AI and the trend of data producers locking up open access data sets, this is shifting AI from its traditional reliance on manually crafted datasets to collecting vast amounts of data from the web, with all the legal, ethical and privacy concerns involved. The Gov Lab report contends a focus by AI developers on data quality could also help counter some of the ethical and policy challenges arising from data use by large language AI models, including improving protections around how AI obtains access to training materials and greater protection around the use of personal data. Improving transparency and documentation of open data can not only foster ethical and responsible use throughout the data lifecycle, but can also help data holders and users to better evaluate the lineage, quality and impact of the output. This is particularly important when using open data for inference and insight generation, data and model augmentation, and open ended exploration. Another benefit of increased focus on quality open data noted by Iglesias is improved transparency regarding AI’s algorithmic functioning. This could contribute to building public trust and transparency not only in large language learning models, but in the government policies and decisions made based on information derived from them. ## **Conclusion** The intersection of AI and open data is transforming government decision-making by enabling policymakers to synthesise large amounts of diverse data across disciplines, breaking down silos and generating new insights. But whether it is also shifting the relationship between the two in a way that could deliver substantial benefits to the open data community is a discussion Link Digital will continue to follow with great interest. ## **Want to talk more about how you can unlock the power of your open data?** [Contact us](https://linkdigital.com.au/get-in-touch/) and one of our data experts will be in touch. **Categories:** All articles, Artificial Intelligence, CKAN, Environmental/Climate Change, Government, Higher Education/Research, Industry, Non-profit/NGO, Open Data **Tags:** CKAN, open data --- ### [The Department of Human Services gets a new responsive design](https://linkdigital.com.au/news/2012/07/the-department-of-human-services-gets-a-new-responsive-design/) **Published:** July 7, 2012 **Author:** Steven De Costa **Content:** Link’s redesign of the Human Services website commenced with the production of three design concepts. An agreed approach was then informed by extensive stakeholder consultation. From the conceptual stage, additional ideas for treatment of content elements and user interaction were already being planned for, particularly in terms of the technical approach required. Our design solution is compliant across all accessibility guidelines and includes additional style sheets for mobile, tablet and print. **Categories:** Government, Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** Canberra web design, Government web designe, responsive design, Thought Leadership --- ### [Beer and Pizza with Link Digital (AKA Online Communications Workshop)](https://linkdigital.com.au/news/2012/06/beer-and-pizza-with-link-digital-aka-online-communications-workshop/) **Published:** June 21, 2012 **Author:** Steven De Costa **Content:** Link Digital is starting an informal series of online communications workshops, with the first being planned for August. We’re interested to hear requests on the topics people would like us to cover. At this point we are considering a Federal Government focused session first, covering the following: 1. **Responsive design** – a lightly technical and mostly user centric run through of considerations when designing sites for desktop, mobile and tablet variations. We’ll use the [Department of Human Services](http://www.humanservices.gov.au/) site as an example. The new site which Link Digital designed and templated for mobile, tablet and desktop went live on 16 June 2012. 2. **The mechanics of effective web teams** – we have 10+ years of experience running a studio that needs to manage and deliver on multiple projects at any one time. Government web teams deal with the same responsibilities and face the same problems. We’d like to share some tips on how to setup, improve or simply work with a team responsible for developing and maintaining a diverse set of online assets. In this session Jessica Salvage will be able to share highlights from the work she’s done in establishing the 3-5 year web management plan for [FaHCSIA](http://www.fahcsia.gov.au "FaHCSIA"). 3. **Web content management systems, open source and open data** – lots of Agencies appear to be considering or deploying Drupal, how much do you know about it? Well, the CMS you use isn’t as important as how to go about using it and there are a few things to think about. We’d like to explore three very different CMS platforms and once again take a lightly technical and mostly user centric approach on the exploration of Drupal 7, WordPress 3.4 and LinkCMS 3.3 (for those that don’t know about LinkCMS, it powers a [growing list of sites](/news/category/services/online/linkcms "LinkCMS sites")). We also want to get people thinking about the data behind some of their content and how they might aggregate and expose it in meaningful ways for others to consume. 4. **Building a social profile –** running through anything to do with social media in a workshop with Government is a bit of a risk as many agencies are still coming to grips with their social media objectives, strategies and policies. However, there is a topic of universal interest that is easy to discuss without having run down too many rabbit holes along the way. If you strip away online engagement from social media channels and focus purely on the creation of a social profile driven by the content you publish on social platforms, then it’s easy to define a starting point for any Government agency to ‘pre-engage’ online with limited risk. 5. **Beer and Pizza –** this will be a practical session within the workshop format. Having our studio right next door to Debacle in Braddon will deliver rewards for those who attend! **Date:** Will be announced in the first week of July and is likely to be held in the second week of August. **Venue:** Link Digital, 32 Lonsdale St Braddon **Registration:** Just [send us an email](mailto:info@linkdigital.com.au) to let us know you’re interested. Once the date(s) are confirmed we’ll send out invites to everyone who expressed an interest. **Categories:** Drupal, Government, Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** Thought Leadership --- ### [Brisbane City Council launches it's new open data platform.](https://linkdigital.com.au/news/2015/07/brisbane-city-council-launches-its-new-open-data-platform/) **Published:** July 3, 2015 **Author:** Steven De Costa **Content:** As [anticipated in late May](http://www.linkdigital.com.au/news/2015/05/brisbane-city-council-selects-link-digital-to-deploy-and-manage-an-improved-open-data), Brisbane City Council have launched their new open data platform at [data.brisbane.qld.gov.au](https://www.data.brisbane.qld.gov.au/) ahead of [GovHack 2015](https://www.govhack.org). The new platform is based on CKAN with additional features implemented via Drupal. It has been established for ongoing management by Link Digital on Amazon Web Services. Brisbane City Council has adopted the metadata schema shared by data.gov.au, data.sa.gov.au and data.nsw.gov.au. This puts it in a great position for metadata sharing between other councils and the QLD state platform if and when such a requirement is established. Notable datasets include CityCat, CityFerry and CityHopper Timetables, a listing of Ferry Terminals and references for the Brisbane Ferries Monitoring API. You can also grab real time data of traffic volume and occupancy of lanes at Council signalised intersections and approaches. Link Digital is able to offer Australian Government entities CKAN, Drupal and AWS hosting, support and consulting services under procurement options within the [Department of Finance Cloud Service Panel](http://www.linkdigital.com.au/news/2015/05/link-digital-amazon-web-services-and-the-cloud-services-panel). Along with establishing Brisbane City Council on the platform established for this panel we have recently contracted with the NSW Department of Finance and Services to migrate [data.nsw.gov.au](http://data.nsw.gov.au/) over to our managed platform. ![](https://linkdigital.com.au/wp-content/uploads/2017/08/BCC-responsive-2.png) **Categories:** Amazon Web Services (AWS), Drupal, Government, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Joel Wigley Joins Link Digital as Our System Operations Team Lead](https://linkdigital.com.au/news/2016/11/joel-wigley-joins-link-digital-as-our-system-operations-team-lead/) **Published:** November 1, 2016 **Author:** Steven De Costa **Content:** Each year, Link Digital signs over 20 new hosting and support agreements for websites and open data portals. An expert ability to manage programmable infrastructure on Amazon Web Services is a key requirement for developer operations. We have expanded our system operations capability with the appointment of Joel Wigley in a team leadership role to further deepen our expertise in managed cloud hosting. Joel started out as a first-line support agent on the helpdesk of what became one of Australia’s largest hosting companies and worked his way up to become a highly-skilled professional combining both Customer Support and System Administration responsibilities. Introducing the new role of a System Operations Team Lead is an investment in supporting our existing and new managed hosting clients over the years ahead. If you are interested in learning more about managed cloud hosting on Amazon Web Services please feel free to get in touch via [info@linkdigital.com.au](http://info@linkdigital.com.au). **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [High Availability with OpsWorks](https://linkdigital.com.au/news/2016/11/high-availability-with-opsworks/) **Published:** November 3, 2016 **Author:** Steven De Costa **Content:** At the beginning of September, Link Digital, represented by our Lead Architect ANZ, [Shane Davis](https://www.linkedin.com/in/kiwicloudninja), delivered a speech at the [Canberra Infracoders Meetup](http://www.apple.com) covering the opportunities and availability of [AWS OpsWorks](https://aws.amazon.com/opsworks/). Started with the development history of [Cloud Computing](http://www.apple.com), Shane outlined its basic operating principles and benefits. Being a next stage of computer technology evolution, Cloud is not only a scalable, high-security, and high-efficiency service but also a cost-effective one. Cloud based computing successfully supports such business models as Infrastructure as a Service (IaaS), Platform as a Service (PaaS) and Software as Service (SaaS). It is perfect for developing open data portals, since collaboration in a cloud environment makes the communication and sharing processes much easier and faster. Being a veteran developer of government open data portals, using PaaS approach, Link Digital, is a regular user of AWS OpsWorks. AWS OpsWorks is a cloud based application management of high flexibility which makes it easy to deploy all sorts of applications regardless of its size and complexity. OpsWorks allows to spawn and tear down instances in no time and effort, granting as much storage as needed. And most importantly, with OpsWorks it becomes much easier to manage the full application cycle including resource provisioning, configuration management, application deployment, monitoring and access control. Cloud computing with AWS is a revolutionary step in delivering digital services that significantly reduces infrastructure complexities and provides fast and effective solutions. To view the whole presentation, please, use the link: **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Link Digital Gets Involved in the Construction Sector: Our Collaboration with Village Building Co.](https://linkdigital.com.au/news/2016/11/link-digital-gets-involved-in-the-construction-sector-our-collaboration-with-village-building-co/) **Published:** November 4, 2016 **Author:** Steven De Costa **Content:** Earlier this year, Link Digital rebooted its collaboration with one of Canberra’s best-known property developers, [Village Building Co.](http://villagebuilding.com.au/), a client we have been working with since 2004. We launched a series of new websites for development projects, culminating with a new corporate website launch in July. A new marketing strategy was first developed and pitched in partnership with [Threesides Marketing](https://threesides.com.au/), who was brought into the team to help support Village’s incoming CEO, [Travis Doherty](https://www.linkedin.com/in/travis-doherty-27802774). A 360-degree review of all communications revealed a list of high-value recommendations which were prioritized ahead of the 1 July launch of a refreshed corporate brand. With over 25 years of experience building communities, a still growing [Village Building Co.](http://villagebuilding.com.au/) has organically developed its approach to sales and marketing with only a few strategic reviews undertaken over the last ten years. Key areas where we are building capability include process automation and digital marketing, supported by data and insights that are being written into the processes flow. The vision is to provide internal transparency for those working over all aspects of the product development, marketing and sales. We’ve named this as the Smart Village initiative and are continuing to work on process support features that enable greater clarity and collaboration between internal and external stakeholders. Technically, we are running a [Drupal](https://www.drupal.org/) CMS with multisite to support a corporate site, internal communications blog and landing pages. This is all deployed within [Amazon Web Services](https://aws.amazon.com/?nc2=h_lg) and the process support features are being designed from the ground up within an API-first software architecture model. This will make it easier to extend and connect processes within Village while also offering the opportunity for third party integration should Village elect to partner with third parties for any part of the process. Link Digital is excited to be involved in the project aimed at developing sustainable communities across Australia both for the current and future generations. We’re also very excited about being able to bring our more recently developed expertise in data management systems to such a long standing and valuable client. **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Google Security Update: Get Your Website Ready!](https://linkdigital.com.au/news/2016/12/google-security-update-get-your-website-ready/) **Published:** December 5, 2016 **Author:** Steven De Costa **Content:** ![](https://linkdigital.com.au/wp-content/uploads/2017/08/Thumb-Google-4.png)Beginning in January 2017, Google Chrome will mark websites that ask users to enter passwords or credit card details without encrypted access as non-secure. This change is intended to make it more evident to users of the higher security risk associated with unencrypted connections but it may come at the cost of decreased user trust in the websites being labeled. The change is part of a staged process, whereby Google Chrome will gradually implement stricter criteria to determine whether a website is secure or non-secure; eventually, any website not using HTTPS will be labeled non-secure. **Why switch to HTTPS?** Before making a change, it is important to understand what the difference between HTTP and HTTPS is and what the benefit for your website will be. HTTP (Hyper Text Transfer Protocol) is a system for transmitting and receiving information across the Internet. HTTPS (Hyper Text Transfer Protocol Secure) is the same protocol, only secure. In an HTTPS connection, the data sent between your website and your client’s browser is encrypted, making it extremely difficult for a hacker with ill-intent to intercept and read the information. In other words, with an HTTPS connection, when a user enters private information into a form on your website, the information is secure as it travels across the Internet. With a regular HTTP connection, the information is vulnerable. As well as being a contribution to a more secure connection, migration to HTTPS will also help not to put your audience off the website labeled as non-secure. **Our recommendation** In order to ensure your website visitors with a secure online experience, we recommend switching from the HTTP to HTTPS in the near future. To make a switch from HTTP to HTTPS on your website, please, get in touch with us via . For more information visit: **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [AWS Associate Architect, done. AI Rekognition Web App for Images, done.](https://linkdigital.com.au/news/2016/12/aws-associate-architect-done-ai-rekognition-web-app-for-images-done/) **Published:** December 7, 2016 **Author:** Steven De Costa **Content:** Amazon Web Services announced a few really interesting services during re:Invent last week. One that caught my attention was [AWS Rekognition](https://aws.amazon.com/rekognition/). What does Rekognition do? Well, it provides developers with the ability to understand images with confidence. But, don’t take my word for it, [here is a simple test application I published today](http://rekognition.links.com.au). I might have published sooner, but I was busy studying for the AWS Architect Associate Level exam (which I passed just this morning). What will we use Rekognition for at Link Digital? Well, we have a few relevant projects already in the queue for the semantic markup of image assets. Based on our extension of CKAN as a digital asset management system, which we’ve demonstrated at [data.wearecbr.com.au](http://data.wearecbr.com.au) (Drupal experience) and [data.wearecbr.com.au/data](http://data.wearecbr.com.au/data) (CKAN experience), we’re thinking that the extension published as [CKAN Galleries](https://github.com/DataShades/ckan-galleries) is now primed and ready for integration with our benevolent and time saving AI overlords. But really, how helpful is rekognition? Here is one example taken from the photo library of our Exectutive Director, Steven De Costa, who was in attendence at re:Invent: ![AWS AI Rekognition ](https://linkdigital.com.au/wp-content/uploads/2017/08/Content-Image-1-4.png) The picture was taken during the re:Invent partner day, during the end of the morning session where the CEO of Amazon Web Services, Andy Jassy, was giving the 4,000 odd attendees schooling on what customers need (hint: partners with more trained and certified staff, like me). The value which rekognition provides is a shortcut on the markup of such an image, suggesting perhaps the most obvious tags which could be associated with it with confidence, along with a longer tail of lower confidence tags (for this image there were another 15 suggestions with confidence lower than 90%). However, the fun is in playing with rekognition yourself, which is why I put together the simple test script [you can now use](http://rekognition.links.com.au). If you’d like to contribute and improve this basic test page, please check out our [rekognition repository on GitHub.com](https://github.com/DataShades/rekognition). And remember, I’m traditionally a SydAdmin rather than a coder, so I’m very appreciative of any suggestions delivered via issues or pull requests. ![AWS AI Rekognition ](https://linkdigital.com.au/wp-content/uploads/2017/08/Content-Image-2-4.png) **UPDATE** Two months later I got my third and final associate level certificate, the SysOps Administrator associate. **Categories:** Amazon Web Services (AWS), Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Open Data for the People](https://linkdigital.com.au/news/2016/12/open-data-for-the-people/) **Published:** December 12, 2016 **Author:** Steven De Costa **Content:** Link has produced what we guess is an essay that articulates the direction in which we think open data portals should point. From our perspective this is something of a positioning statement as it represents what we’ve come to understand via the amazing learning opportunity we’ve shared with our clients and the many vibrant ‘open’ communities since late 2012. There is still much to learn, which is coming through faster than ever. 2016 has been an epic year. 2017 will be something special again! PDF Download: [Open Data for the People](https://linkdigital.com.au/wp-content/uploads/2016/12/LINK_DIGITAL_OpenData_for_the_People.pdf) ![Open Data for the people image](https://linkdigital.com.au/wp-content/uploads/2017/08/Gregs-post-image_v3-4.png) **Categories:** CKAN, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [New Zealand, Link Digital is now in your base.](https://linkdigital.com.au/news/2017/02/new-zealand-link-digital-is-now-in-your-base/) **Published:** February 3, 2017 **Author:** Steven De Costa **Content:** \_ Over our entire 15-year history headquartered in Canberra, Australia, Link Digital has specialised in the provision of digital services to Government clients. In the last four years, we have deepened our expertise in - Cloud architecture and managed services, - Drupal web experience design and development; and - Open Data platforms based on CKAN. As one of the few digital agencies worldwide with such a specific skillset we’re now being asked to collaborate on projects in multiple timezones. With staff now located in Kharkov (GMT +2), Perth (GMT +8), Canberra and Sydney (GMT +10) and Auckland (GMT +12) we can ‘follow the sun’ to be available when needed. Our entry into New Zealand, however, is a significant step. New Zealand is a member of the Digital 5, which includes UK, Estonia, Israel and South Korea. We’re following their leadership with the aim of supporting New Zealand’s digital economy with open data. > *The Digital 5, or D5, is a network of leading* [*digital governments*](https://en.wikipedia.org/wiki/Digital_government "Digital government") *with the goal of strengthening the digital economy. The members are bonded by the principle of openness; they are focused on changing government’s relationship with technology by adopting* [*open standards*](https://en.wikipedia.org/wiki/Open_standards "Open standards") *and* [*open-source software*](https://en.wikipedia.org/wiki/Open-source_software "Open-source software") *as well as making digital government more effective. They intend to bring in digital skills in-house and encourage short-term contracts with small and medium business suppliers.* > Source: https://en.wikipedia.org/wiki/Digital\_5 The New Zealand office will specialise in providing an end-to-end service surrounding data publishing on [CKAN](http://ckan.org/), including platform establishment, hosting, ongoing support, and maintenance. > *“Opening an office in New Zealand is an investment in supporting a country committed to strengthening its digital economy with open Government and open source software. Our contribution is a small addition to the vibrant Open Data community in New Zealand, but by being here we will learn and share a lot of knowledge.”* > [Steven De Costa](https://www.linkedin.com/in/stevendecosta), Executive Director, Link Digital. [Shane Davis](https://www.linkedin.com/in/kiwicloudninja), Link Digital’s lead architect for Australia and New Zealand will head up operations in Auckland. Shane is an IT veteran with over 25 years experience in software development and infrastructure management. He led the delivery [commitments made at the Whitehouse Roundtable](https://linkdigital.com.au/news/2016/09/link-digital-delivers-on-white-house-open-data-commitments) in June 2016 and continues to work on high level architecture improvements for our open data systems. Follow [Link Digital on Facebook ](https://www.facebook.com/LinkDigital/)to stay updated on news and events, now from both Australia and New Zealand. **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Discounted rates to the ACT grant applicants!](https://linkdigital.com.au/news/2017/05/discounted-rates-to-the-act-grant-applicants/) **Published:** May 4, 2017 **Author:** Steven De Costa **Content:** Are you an ACT community organisation striving to make a positive difference in the lives of Canberrans? Would you like to draw more people to participate in the development of your community programs? One of the best ways to do so is by simply enhancing your presence on the Internet. The ACT government has launched the [2016-17 Participation (Digital Communities) Grant Program](http://www.communityservices.act.gov.au/multicultural/programs/grants/participation-digital-communities-grants/2016-17-digital-communities-guidelines) which is designed to assist local community organisations in engaging the Canberra community through the use of digital technology. At Link Digital, we value every contribution towards a more open, equal and collaborative society. One project which aims to do just that is [data.wearecbr.com.au](http://data.wearecbr.com.au/) and we are extremely proud to be involved in it. If you are considering putting forward an application for the grant, we are happy to **offer your organisation discounted rates** to have your online presence enhanced. For more information, please feel free to contact us via [info@linkdigital.com.au](http://info@linkdigital.com.au). **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Certification Matters](https://linkdigital.com.au/news/2017/06/certification-matters/) **Published:** June 6, 2017 **Author:** Steven De Costa **Content:** I recently acquired my AWS Solutions Architect Professional certification. It took much longer than it should have, and in the end, it wasn’t nearly as difficult as I imagined it to be. The “magic” formula I’d tried to discover for passing was really quite simple in the end. My aim here is to share it with you to make your journey faster and easier than my own. ## Why get Certified If you don’t really understand the significance of certification, why you should be certified, you’re really going to struggle obtaining it. Often it’s not until you’ve conquered an obstacle that it’s true significance becomes clear to you. For many, they’re pressured into certification because their employer requires or demands it. Alternatively you might have some niggling doubts around the depth of your skills or ability. Negative motivators don’t work anywhere near as well as positive ones. Focusing on the tangible benefits of your accomplishment will propel you forward far more effectively because excuses become ineffective. It’s only yourself that you’re holding back when it’s you that you’re investing in by becoming certified. For me, the most important reason to get certified is the debt you owe to your clients to offer them the soundest advise possible. AWS encapsulate this in their first leadership principal: “Customer Obsession”. While I was studying for my exam, I came across absolute gems of information, that had I known prior to certain customer engagements, would have provided an even better solution than I implemented. Sure I solved problems, and implemented satisfactory solutions. There was potential there for them to be so much better, had I only known all the finer details. The second most important reason to get certified is the value you add to yourself. Not only as an asset to your current employer, but as a skilled commodity in the competitive market of highly skilled professionals. If your ambition is C title executive at some point in your career, you need to invest in the value you provide now, and into the future. ### Step 1: Prioritize I’ve worked with AWS services for about 5 years now. I accomplished Associate level certifications quite easily. I accomplished that by just setting aside a couple of weeks after leave to focus on study. Acquiring the first certification felt great. The next two associate levels came fairly easy. I had the base knowledge required, and basic understanding is all you really need to pass the Associate exams. Two years later, when asked why I didn’t have my professional level certifications, the best I could come up with was, “I’m chipping away at it.” Rightly so, I was asked what does that actually mean? What it means is not giving it the priority it needs to have. It made me realize to actually acquire those certifications I needed to make them an urgent priority. That’s where the importance of why comes in. It motivates you to do something for the right reasons. When certification isn’t a priority, “real work” will always get in the way. Even when you’re telling yourself you’re working towards it. When I reflected on my efforts, I identified that I’d invested a lot of isolated efforts that collectively weren’t propelling me forward very fast. That’s what happens when certification isn’t an urgent priority. It always ends up on the back burner. Commit to an exam using your personal finance and you’ll be amazed how fast study becomes your main priority. This shake up ensures that only the most valuable work and email gets done, while you focus far more intently on study. All your spare time becomes study time. I put up my own money, booked an exam two weeks in advance, and only rescheduled for an extra week. The practice exam revealed I needed just a little bit extra reading to cover of the essentials I needed to pass. Commit and you will prioritize! This reflects another great AWS Leadership principal, “Bias for Action”. ### Step 2: Prepare Of all the “chipping away” I did over the past couple of years, three things I did were highly beneficial. They were: Speed reading, AWS Study group and sharpening my thinking skills. #### Speed Reading: One comment people frequently make about the AWS Pro level exams is that the questions are long and complicated. If you have a go at the practice exams, you’ll learn first hand what they mean. I took a practice and bombed big time. Not just because of my lack of in-depth knowledge in certain areas, but also because the questions took so long to read and comprehend. Within a couple of weeks, I taught myself to speed read. There are hundreds of books on the topic so find one that works for you and get your reading speed up. I now read about 3 – 4 books a week. I can actually read faster than listen to an audio book and glean even more out of the content. #### AWS Study Group: The most important thing I got out of the AWS Study group was understanding how to tackle the exam. If you study the questions in the practice exam carefully, you’ll see the correct answer is in the question itself. Look at the possible answers. One or two will be completely wrong. Another will be missing a critical ingredient that the question poses. Often this will leave you with two similar but opposite options. Look at the question. What domain is it quizzing you on? Cost, availability, security or scalability? Identify the critical element and the conflict will resolve itself. On one of the practice exams I got 0% on cost because most of the solutions I need to architect at work have to be highly available. I got 100% for that metric in the same practice. To resolve this anomaly, I reviewed all the questions about cost and immediately identified my bias and error. My natural bias toward availability stopped me selecting the obvious answer around cost. On the actual test the very next day, I got 100% for cost. #### Thinking Skills: If you haven’t already read it at least three times, read the Five Elements of Effective Thinking by Edward B. Burger and Michael Starbird. In it you’ll find essential tools for improving your thinking, and for the actual exam you’ll need them, as the pressure of the time constraint kicks in. An example of an essential thinking is learn the basics deeply. Forget the fluff, and get at the essence of the topic. This will prove invaluable for getting at the essence of the exam questions. Some of the options thrown in are designed to distract your thinking. Red herrings so to speak. ### Step 3: Commit to Study Traditionally I’ve been a very hands on learner. That approach is great for fairly in-depth learning to solve specific problems. In order to pass the exam however, what you need is solid well grounded knowledge of the basics. I found just by studying the developer guides, and really understanding each key element thoroughly, by taking notes, that got me through the lengthy questions and answers quickly. That sound knowledge allows you to cut through the noise and get at the answer. There are half a dozen questions I can think of that reflect why good basic knowledge will help you pass. Why site stats suddenly dropped off after enabling CloudFront on a site. Why one AZ saw no traffic during load testing. Simply reading the developer documentation thoroughly and understanding the core concepts will help you pass with surprising ease. #### Top Tips: Once you’ve committed to an exam, schedule time early in your day to study solidly and consistently. Get up early in the morning, do some physical exercise, cold shower and you’ll be amazed how much you absorb in a solid hour of uninterrupted study. All the AWS documentation is available on Kindle, so my personal approach was download the Kindle version, read it cover to cover, taking hand written notes the whole time. Hand written in your own words is important because it forces you to understand the concept, and the process of hand writing commits the concept to memory using your own imagery and understanding. #### Stay committed If you really want to be a master in your domain, don’t let all that hard earned study go to waste. Once you’ve established a pattern and habit of learning and studying, certification is only the beginning of where you can go. When you’ve firmly grasped those concepts, a world of possibilities opens up. Here’s just a few things I accomplished at Link Digital while studying for exams: Open Source CloudFormation and OpsWorks stack for our data platform builds: https://github.com/DataShades/opswx-ckan-cookbook Centeralized SSH Bastion host for SSH access to managed instances STS based cross account access using management IAM roles Federated AWS console access from our corporate user directory using Single Sign-on (SSO) A big challenge in any job and organization is growing your skill set because the scope of work you do on a daily basis is often so narrow. AWS Professional certification is an assured way of broadening your capabilities, encapsulating best practice and leveling yourself up. Not only do you owe that to yourself as a skilled professional. You owe it to your clients. If at the end of this you’re still fishing for motivation, try reading, “The Obstacle is the Way” by Ryan Holiday. **Categories:** Amazon Web Services (AWS), Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [How to Survive and Thrive Working Remotely](https://linkdigital.com.au/news/2017/06/how-to-survive-and-thrive-working-remotely/) **Published:** June 16, 2017 **Author:** Steven De Costa **Content:** Working from home is **the dream of many office workers, and the nightmare of others**, who even given the opportunity, are reluctant to surrender an office arrangement. [As an offshore remote worker](https://linkdigital.com.au/news/2017/02/new-zealand-link-digital-is-now-in-your-base), I have a lot of first-hand experience with this arrangement and would like to share some of the benefits and challenges of remote working. Approximately three years ago, Link Digital transformed itself into an organisation capable of supporting a remote workforce. This entailed **moving all systems online** and fundamentally changing the way the workforce organises themselves and work together. [As an AWS consulting partner](https://linkdigital.com.au/news/2012/10/amazon-web-services-arrives-in-australia), Link Digital had a strong starting point, with all critical systems being hosted in the Cloud. One of the first steps Link took was migrating onsite systems to the Cloud. As such Link use Atlassian products for project tracking, and Xero for administrative work. Google Apps and Dropbox are used for collaboration and file sharing. Rapid communication is accomplished with HipChat and Australian based Maxotel provide the VoIP phone capability. ## Remote working is far more than having online tools, however. It requires a whole shift in mindset from everyone in the organisation. Even with all the tools, actually working remotely, and offshore requires strict discipline and fluid collaboration. Although Link uses Zoom video conferencing, this isn’t used nearly as much as IM chat and phone calls. Link conduct scrum stand-ups and retrospectives with Zoom, but the most regular contact is HipChat. This is the case whether in the office or not. If you’re working remotely for the first time, one common issue myself and colleagues agreed was difficult, is **visibility**. Someone can sit in an office all day and do absolutely nothing productive, and yet they are, “at work”. When you first start working remotely there’s a tendency to always be available. Always logging hours, and somehow making it obvious to everyone you’re not lazing around in your PJs all day sipping cocktails by the pool. You’re much more likely to be even more productive than you ever were in the office. ## Focused attention is usually one of the really big payoffs for remote workers. I actually start working around 6 – 7 am when I’m at my absolute sharpest. I can get in 4 – 5 hours of solid uninterrupted work, and my [workmates ](https://linkdigital.com.au/content/people)in Australia are only just rolling into the office to start their day at 9 am. My morning isn’t shaken up by a morning commute, so rather than losing the most precious hours of alert mental focus in transit, the work I’m producing is usually of a much higher caliber. In terms of availability, in an office environment, very few people sit at their desk for 8 hours solid. If they do, that’s an immediate red flag for productivity because they’re not getting the mental rest they require to work at their best. At home then, or working remotely, it doesn’t make sense to be wedded to your workstation or phone like an emergency worker on standby. It requires a big mental shift on your part to understand at the office you’re often away from your desk a lot. Getting coffee or in meetings, if not out at lunch or visiting clients. Regular mental rests for creative and knowledge workers is absolutely critical, and yet, there is still an industrial mindset when it comes to productively. I personally believe **the single biggest challenge we face when it comes to work is focussing on hours rather than outcomes**. I absolutely loathe logging hours because it doesn’t get anywhere near the actual investment I’m making toward my job. The single biggest change that needs to take place in my view, is not physical locality of workers, but the outcomes they’re producing. I think the best analogy is paying $80 or more for a five-minute consultation with a Doctor. The lay person is thinking, “$80 for five minutes! I’m in the wrong profession.” Anybody with a bit of knowledge and insight understands you’re not literally paying for those five minutes. You’re paying for an outcome. A diagnosis and solution to your ailment. Physical location and actual actively has next to nothing to do with output when you are a knowledge or creative worker. As a developer, I’ve smashed away at a problem for a good hour or more making no tangible progress. I take a walk for a few minutes to clear my head, and almost instantly, the solution to the problem is there. I walk another thirty minutes nutting the whole problem out in my head. Upon return to my desk, I spend five minutes implementing the solution. **This is how creative thinking works**. If I accurately logged every waking moment that contributes to my capability at work, I’d have to log about 12-14 hours a day. When you’re a developer, architect or creative worker, your mind is thinking about your craft all the time. When I’m not actually working, I’m often reading articles about the latest trends and tools related to my work. How do I log that time? I went through a phase of logging every single moment of my work day and it was infuriating. It was just so difficult to accurately capture everything I worked on or contributed towards, and yet, depending on your organisation, billable hours are often a big issue. This is another big change that needs to take place. Clients should be paying for projected milestones, not the time it takes to do something. One of the biggest flaws in waterfall projects is how badly people under or over estimate time and effort. Some solutions come very quickly because it deals with an issue you’re very familiar with. Other solutions take a lot longer because of constraints and variables that just couldn’t be foreseen. How does all of this relate back to remote work though? ## The greatest benefit of working remotely is finding what works best for you. The pattern of activity that **produces the best results**. It’s not always as easy as you’d think, and thinking differently can catch you by surprise. I discovered a long time ago working in a fairly flexible office environment, a forty minute chunk of intense work, then five to ten-minute walk around the block is a very good formula for being productive throughout the day. At home, a solid stint of ninety minutes will often occur, then I’ll get something done around the house or in the garden. There are vast amounts of neurological research over the last decade that reveals just how beneficial rest is to productivity. I once had a developer who pushed himself to 14 and 16 hour days. His work was often unusable. He made serious mistakes and frequently lost code accidentally by deleting files unintentionally, reverting code commits and many other fatigue-related errors. In my younger days developing, I would often look at the buggy code I’d written earlier in the week and wonder to myself what I had been thinking. In reality, I hadn’t been. I often did long uninterrupted stints of coding, and as mental fatigue set in, I made simple, pointless mistakes that later cost me hours in debugging, pinpointing one silly typo or error. The single most powerful thing you can do as a remote worker in my view is **fundamentally change the way you think about work** in order to provide the best value to your organisation. Fortunately, there’s a few **tools and techniques** you can use to accomplish this. So far as communication and availability goes, I have an IM client installed on my phone so no matter where I am, or what I’m doing, I can nearly always be reached. If it’s critical, I’m a phone call away. I check my work email twice a day. Once in the morning, once in the afternoon. This approach reduces the number of distractions I have to almost zero. If it’s critical or urgent, people will phone or IM you. So far as productively goes, this is where you can get truly creative. It also requires some imagination on your part, and yes, you’ll be doing some of the things people view negatively about remote work. So long as you’re in a quiet productive space, it really doesn’t matter where you’re physically located to do your work. The biggest challenge for you personally is that niggling feeling, “this doesn’t feel like work.” A few weeks ago I needed to take my car in for a service, with a two-hour wait. I sat in a cafe those two hours, sipping coffee and putting in a solid two hours of activity. It didn’t feel like work. We’re so used to being mentally pegged and fighting for concentration, that when that isn’t the case, it doesn’t feel like you’re putting in any real effort. The other week I needed to study for an important exam. I had been sitting in my office, at the desk reading and taking notes. It occurred to me that on a nice sunny afternoon, I could actually be sitting on the balcony, enjoying the sunshine using my tablet to read and take notes. Again, it felt effortless and enjoyable. I would have absorbed more in that hour or so of intense study that cooped up indoors slogging through the same material. I’ve come to realise that **when it comes to a lot of my work, I’m getting through it far more effectively** with far fewer errors than I would have in the office environment. That presents an interesting challenge. It’s much harder to log the same number of hours. I power through my workload in the first few hours of the day. An interesting side effect of this more efficient productively is that in the last few weeks of having time to study my craft, I’ve probably gained more in-depth knowledge and understanding of the technologies I work with than the last four years collectively. I have time and resources to think and study. In the industrial world, this isn’t considered a productive use of my time. In terms of coming up with newer better solutions to customer problems, it’s invaluable. There are many other benefits and challenges that would turn into a book rather than a short article. The most important aspect of remote work for everyone, employers, employees and the people they serve is. Rethink the way you work and measure productivity so it’s outcome focussed, what’s accomplished, rather than time focussed. ## How we measure value really needs to change for remote workforces to truly make a difference. We build more and more roads to needlessly move people to places they often provide less value in, than right where they are working flexibly. Remote workforces have the potential to produce healthier, better-adjusted communities that add significantly more value to the economy and wellbeing of the planet overall. We simply need to move on from our industrial mindset into everything the twenty-first century has the ability to deliver. **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Some More of the Best Ways to Get Real-World Programming Experience in Data Science](https://linkdigital.com.au/news/2017/06/some-more-of-the-best-ways-to-get-real-world-programming-experience-in-data-science/) **Published:** June 23, 2017 **Author:** Steven De Costa **Content:** Whilst Data Scientist jobs have been flooding the market, you are generally required to have a broad experience in the field to actually get a job. Lillian Pierson ([@BigDataGal](https://twitter.com/BigDataGal)), the author of *Data Science for Dummies*, has recently published a post on her blog [Data-Mania.com](http://data-mania.com/) which, among other things, points out [three ways people can get real world experience in data science](http://www.data-mania.com/blog/Get-Real-World-Programming-Experience/). The focus of her article was about paid work in data science. So, I thought I would add a few more ways to get some great experience **without even needing to find a job** in data science. **Option D:** Contribute to open source projects related to data, data management, and BI/insights. Not only will you get credit for your contribution, but also help such projects thrive. For example, you could build your own data [resource view for CKAN](http://docs.ckan.org/en/latest/maintaining/data-viewer.html) and test it on real public data from data portals around the world. **Option E:** Join a civic hacking group and build things which benefit your local community. It might be some [data journalism to highlight gender wage gaps](http://2015.hackerspace.govhack.org/content/glass-ceiling-index), a [budget lens for your local government](http://theopenbudget.org/) that shows where tax revenue is spent, or [something mappy to show the ‘where’ and ‘what’ together](http://www.opentrees.org/). Connect, collaborate and contribute – you’ll learn a lot, grow your network and help your community while also having a great time. **Option F:** [Citizen science](https://en.wikipedia.org/wiki/Citizen_science)! Conduct your own research and generate data to test your own hypothesis – build a survey, or work with sensors. Pull your data together and publish with your own analysis and insights. Best of all, with these options, it doesn’t matter what you do to pay the bills. You can work for the love of it and find out what fires your passion. **Categories:** Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Creating Meaningful Change With Open Data](https://linkdigital.com.au/news/2017/11/creating-meaningful-change-with-open-data/) **Published:** November 27, 2017 **Author:** Steven De Costa **Content:** Sixteen years ago on this day, two young, creative and confident Canberrans waked into an ACT Government office building in the city’s CBD to register a new business. Or, to use contemporary terms, two innovative and ambitious entrepreneurs founded their first startup. A month later the startup landed seed funding, the old way, via a 20k overdraft account with ANZ Bank. No security, just a business plan and a list of prospective clients. Based on reputation, talented staff and hard work the business picked up a small number of projects and used the earned revenue to create an absence of failure over its first year. The business was soon incorporated as a company and thus began the story of Link Web Services Pty Ltd on 27 November 2001. To be both brief and honest, the next 15 years were much of the same. We matured into a respected digital agency and began trading as Link Digital in 2004, but it’s continued to be hard work, and the narrow avoidance of failure, which has charted our path forward. Any obstacles which have stood in our way have been cracked and cleared one by one. Somehow we’ve kept this thing going. Daily, monthly, yearly against whatever came our way. Each day in business is a success, and today especially so. Not only is today the first day of Link’s 17th year of operation it’s the day I walked into the office after a five-week experiment to see if Link can effectively operate with my work based in the Central European time zone. The results are in and the answer is yes. So, on this anniversary our staff in Canberra, Perth, Sydney and Kharkiv are all logging in with news that the company will be opening an office in Berlin during the first half of 2018. More clients, more obstacles and more horizons to explore.. It is the strong management team driving Link forward which makes all of this possible. **Angela Hulford:** Our General Manager, who will mark her seventh year with Link in January 2018. Based in Perth, Angela manages the integration of all locations and business areas from Australia’s western time zone, giving her cross over with AEST and CET based staff. **Kate Svetocheva:** Our Sales and Marketing Manager, who joined us only 18 months ago but has proven to be an invaluable addition to the team. Kate’s passion for, and focus on, client success has driven the establishment of our Enterprise Account Management service and paved the way for the creation of Partner Network and Consulting programs due for release in 2018. **Iaroslav Pereiaslovets:** Operations Manager, who will mark his six year with Link in August 2018. As a highly achieving Developer and Technical Product Owner Iaro has been running development team and unit operations since relocating to Canberra from our Kharkiv team in 2015. He will continue to be instrumental in the recruitment, onboarding and management of technical staff in both Australia and Europe. Inclusive of myself, our small and effective management team is, dare I say it, agile. Working together over the last five weeks we have delivered a proof of value for a Berlin office and are today very eager to clear the 2017 backlog and start 2018 in a sprint toward Europe. **Categories:** Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Link Digital Scales Up Open Data Operations From Berlin](https://linkdigital.com.au/news/2018/09/link-digital-scales-up-open-data-operations-from-berlin/) **Published:** September 17, 2018 **Author:** Steven De Costa **Content:** This month Link Digital kicked off its involvement with the [Australian Landing Pad in Berlin](https://www.australiaunlimited.com/landingpads/locations/berlin). Executive Director, Steven De Costa, has been based in Berlin since April this year to help the company expand its open data services in Europe, while complementing an operations team which has been based in Kharkiv for over five years. Pitching its open data services at a formal reception from the Australian Ambassador in Germany, [Lynette Wood](https://twitter.com/ausamb_de), the company presented its globally competitive expertise, gained by developing open data platforms such as data.gov.au, alongside new projects that are underway with clients such as [LEGO Systems](https://www.lego.com) and [The Pacific Community](https://www.spc.int/). ![Australian Ambassador in Germany, Lynette Wood, and Executive Director of Link Digital, Steven De Costa](https://linkdigital.com.au/wp-content/uploads/2018/09/Steven-De-Costa-and-Lynette-Wood.jpeg)Australian Ambassador in Germany, Lynette Wood, and Executive Director of Link Digital, Steven De Costa The company goals for the three month landing pad program include a corporate restructure that will simplify partnerships with NGOs, resellers and complementary service providers. Over the next two years the company expects to expand operations with a strong European team, funded directly by new client acquisitions. Link Digital’s open data services are based on [CKAN](https://ckan.org/), [Drupal](https://www.drupal.org/) and [Amazon Web Services](https://aws.amazon.com/). It is a combination which is in high demand for jurisdictions who wish to publish and promote open Government data. It’s work with corporate clients, such as LEGO Systems, is based on the same open source application stack and is largely driven by the same objective; to make data more discoverable and more accessible so as to increase its value. In such use cases the data remains within the restricted domain of company networks. **Categories:** All articles, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Addis Ababa CKAN Contributor Team Grows and Heads to OGP Canada](https://linkdigital.com.au/news/2019/05/addis-ababa-ckan-contributor-team-grows-and-heads-to-ogp-canada/) **Published:** May 30, 2019 **Author:** Steven De Costa **Content:** Open Knowledge Ethiopia is a local group, under the Open Knowledge Foundation, which is established to work on open government data and open science. The group has run various workshops and training events on open data and open science subjects in collaboration with Addis Ababa University (AAU), attracting participants from academia, CSOs, and policymakers. OK Ethiopia, with support of Link Digital, have now hired three CKAN contributors who are working on a full-time basis, primarily, for the CKAN project. AAU has been very supportive of the group, providing a venue for training and workshops free of any cost. They have also agreed to provide an office space for OK Ethiopia. News about the second hire into the CKAN Contributor team was referenced in the post by Ruth Bekele, “[My First 100 Days as a CKAN Contributor](https://linkdigital.com.au/news/2019/04/my-first-100-days-as-a-ckan-contributor/)“. The most recent development regarding funding has been that NSW Government approved a request from Link Digital to contribute a further $10,000 ex GST into this initiative via a contract addition to data.nsw.gov.au, allowing for a third CKAN contributor to be added to the team. At this time, we have a very excited group of ICT Graduates working on the CKAN project under the leadership of Solomon Mekkonen. Ruth Bekele, who started in November 2018, is currently attending the Open Government Partnership Summit along with Link Digital’s Executive Director, Steven De Costa. Both are there to support the CKAN Association and promote opportunities for Governments to further support CKAN’s continuous development as the Open Government Data platform of choice. ## You Can Support OK Ethiopia and the CKAN Project Too. If you would like to know more about opportunities to support the CKAN project via this initiative, please [get in touch](https://linkdigital.com.au/get-in-touch/) to learn more. ## The OK Ethiopia Team ### Solomon Mekonnen Solomon Mekonnen is an Academic Staff with the rank of Assistant Professor and Open Access Coordinator at the Addis Ababa University (AAU). Apart from his role at AAU, In addition, Solomon coordinates nationally Open Access Programme of an international network called Electronic Information for Libraries (EIFL) representing Consortium of Ethiopian Academic and Research Libraries. He is also a local organizer in Ethiopia for an international network called Open Knowledge. As part of his role as local organizer, he coordinates the Open Knowledge community in Ethiopia focusing on open data and open science. Solomon has participated in a number of projects related to open data and open access at the national and institutional level including a project on opening and visualizing Ethiopian election 2015 data, , Ethiopian Journals online ( as Project Manager), National Digital Repository (NDR). Solomon has graduated with MSc. in Information Science from AAU and completed his PhD in Information from the University of South Africa. ### Ruth Bekele Ruth Bekele was the first full-time CKAN contributor hired in Ethiopia, currently working as a contributor. Before devoting her work full time to CKAN Ruth was a full-time teacher at Akaki Adventist Academy and was working part time at school of language and basic computer skills. Ruth studied her elementary, high school and preparatory at Ethiopia Adventist College and she used to volunteer in summer training given in the school. Graduated her BSc in Computer science from the University of Gondar. She is highly motivated to learn new things. Ruth’s Role is 100% funded by Link Digital donations to OK Ethiopia ### Nehemiah Amanuel Nehemiah has worked in Ethiopian AI pioneer iCog before and after graduation from Addis Ababa University with BSc in information system. Nehemiah has worked on two different project of which one was an android tablet application and the other flask web app. Nehemyiah is currently working as fulltime CKAN developer for Open Knowledge Ethiopia. Nehemiah’s Role is 100% funded by this [GoFundMe campaign](https://www.gofundme.com/ethiopia-needs-open-data-experts). Any shortfall in campaign funds are covered by donations from Link Digital ### Bati Taye Bati studied BSc in Computer Science at Jigjiga University and he is in a graduate class of MSc in computer science specializing in cybersecurity. Baty worked as a Junior IT expert at Hawasa Industrial park in Ethiopia. He is currently working as CKAN contributor for Open Knowledge Ethiopia. Bati’s Role is 100% funded by NSW Government in Australia, who recognise the value of giving back into open source projects where their own programs rely on such open source projects. Several NSW Government data portals are based on CKAN, including most of the portals listed at **Categories:** CKAN, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [What you need to know about the PHP 7.1 End of Life](https://linkdigital.com.au/news/2019/08/php-71-end-of-life/) **Published:** August 22, 2019 **Author:** Steven De Costa **Content:** Reluctance with updates and patches is justifiable especially if your website is working just fine. Yet when a version of a programming language reaches end of life for on-going support, it becomes a whole different story. Companies both big and small will need to take action or risk downtime and security issues which could cripple their online operations. In this article, we’ll discuss what you need to learn about the upcoming End of Life (EoL) for PHP 7.1. ## End of Life Definition “[End-of-life](https://en.wikipedia.org/wiki/End-of-life_(product))” is a term that indicates a product is at the end of its useful life (at least from the vendor’s perspective) and existing marketing, selling and other processes are terminated by the vendor. Simply put, end of life means support will be terminated for a product/software beyond the stated EoL date. Market demands and technological innovation are usually the main driving forces for this occurring. ## PHP 7.1 End of Life (1 Dec 2019) PHP is a general-purpose programming language originally designed for web development. From giant entities like Facebook and Wikipedia to smaller organisations and personal sites, it is a known fact that all Drupal and WordPress websites rely heavily on PHP. Released in 2016, PHP 7.1 provided a significant increase in the site speed of those who upgraded from PHP 5.6 when it reached end of life last December 2018. This coming December 1st, users will be facing a similar scenario – only this time, PHP 7.1 will be the one sunsetting. **What it means** - As of 1 December 2019, PHP 7.1 will officially be an unsupported branch of PHP – meaning it will no longer receive bug fixes or security updates. - Although PHP 7.1 will no longer be actively supported, your website and PHP application will continue to work beyond 1 December 2019. - Using version 7.1 beyond its end of life puts your site at a greater risk to security vulnerability and bugs. **Challenges with upgrading** - Contributed modules and plugins that are no longer actively maintained by their creators may cause potential issues. - Some modules and plugins may create significant regressions in their latest versions, as developers will no longer test for PHP 7.1, and will therefore need to be patched or reverted. **Benefits of upgrading** - Upgrading to a later version will ensure your website and applications are actively supported with security patches released as required. - Later versions are also faster; according to various popular benchmarks, PHP 7.2 runs 12% faster than 7.1 and PHP 7.3 runs 23% faster than 7.1 and 31% faster compared with 7.0. **Time estimate for upgrading** While migrating to a later version may be a complex process, the time estimate for upgrade depends on the complexity of the codebase. Feel free to contact us for a free assessment and quote to upgrade your site. ## Got questions? If you need help in migrating your website to a later version of PHP or if you have further questions about PHP 7.1 EoL, [get in touch](https://linkdigital.com.au/get-in-touch/) with the Link Digital team today. **Categories:** Drupal, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Democratizing CivicTech: Open Data now available to all US municipalities](https://linkdigital.com.au/news/2019/09/democratizing-civictech-open-data-now-available-to-all-us-municipalities/) **Published:** September 4, 2019 **Author:** Steven De Costa **Content:** Open data, for smaller municipalities, has always been a path strewn with obstacles that include cost and technical capacity. This has led to a trough in open data between larger, more affluent public entities and smaller entities. Delivery of an open data program for *all* jurisdictions needs a simple, affordable and appropriately sized solution. A new offer, delivered in partnership between [JMH Associates](https://jasonmhare.com/) and [Link Digital](https://linkdigital.com.au) promises to deliver the right tool for this job. For several years now data portals have been delivering ‘[open data for the people](https://linkdigital.com.au/news/2016/12/open-data-for-the-people/)’, with the promise of benefits flowing through to citizens, communities and economies. Jurisdictions around the globe have invested in a great migration into the nooks, crannies and datastores of their public institutions to discover the heretofore hidden treasure of a datum left unexamined. Nations, States and cities have launched, evaluated and evolved their open data policies and supporting infrastructure in an environment of prophetic enthusiasm. We have applauded each release of a key dataset, circled and studied the site of each impact zone, and for sport we have kept our tally boards and yard sticks in hand to mark each release and measure each gain. To the winners go the spoils; more posts, more shares, more likes and more connections. More data for the trove. More recently the open data community has shifted away from quantity and set a more sensible focus on quality. However, there remains some measure of competitive pressure surrounding the release of open data and this is most obvious in the features being implemented within the portals themselves. Diligent business analysts will helpfully identify which bureaucratic systems have complexities that will need to be addressed, while subject matter experts and academic researchers will deliver compelling cases to expand your imagination to the point where, on reflection, only a complex and feature rich solution seams to fit. However, the United States has always been a “bottom-up” governance model. The Federal Government and State and Local Government don’t often interact except at the broadest of policy levels. Access to data that affects individuals, communities and cultural regions is left to Local Government. In the US this availability is subject to the socio-economic profile of the locality. The volume of valid discourse surrounding open data holds a hidden cost, an opportunity cost. While large vendors and well funded jurisdictions are expanding and refining the scope of open data solutions, the smaller jurisdictions are being left behind. For small municipalities in the mid-atlantic US Region, moving forward with your open data initiative is now simple. 1. [Contact JMH](https://jasonmhare.com/) to complete the public data Assessment questionnaire and participate in a free two hour discovery session. 2. Take delivery of your open data action plan from JMH, with Full and transparent costings included. 3. Decide to take action and partner with JMH to deliver the benefits of public data for your municipale constituents with the proven reliability of CKAN managed by Link Digital. For more information about this collaboration, please refer to our [press release](https://linkdigital.com.au/open-data-for-all/), or email Jason Hare at or Steven De Costa at . **Categories:** Government, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [2019 Year In Review: Link Digital](https://linkdigital.com.au/news/2020/01/2019-year-in-review/) **Published:** January 31, 2020 **Author:** Steven De Costa **Content:** New year, new dreams, new goals. We hope you’re buzzing about 2020 as much as we are here at Link Digital. But, before you launch forward too far into a new year, it’s always good to review the year that was. We started our 19th year in business in 2019 and it has been a memorable year of opportunities, growth and landmark occasions. Inspired by our vision to create meaningful change, our campaign to cross borders with open data landed us the co-stewardship of the [CKAN open source project](https://linkdigital.com.au/news/2019/08/co-stewarding-of-the-ckan-project-is-about-delivering-results-rewards-and-recognition/). Led by core values, we worked with more and more clients worldwide and put a feather on our cap by winning the Emerging Exporter category at the 2019 ACT Export Awards. Here is a short list of our favourite Link Digital moments for 2019. ## CKAN Community Services Link Digital hired two more developers to join Ruth Bekele as contributors to the CKAN open source project. In an [article penned by Ruth](https://linkdigital.com.au/news/2019/04/my-first-100-days-as-a-ckan-contributor/), she said that working as a CKAN Contributor had been an absolute delight, gave her valuable experiences and has her pursuing her career as a developer with more passion. This year, we also launched the community service, Datashades.info, to help researchers, portal managers, and the wider tech community alike in gaining insights from [CKAN data platforms](https://linkdigital.com.au/ckan/) worldwide. ![](https://lh6.googleusercontent.com/ARGjXd-GP0KAgqSiGFvaAu1NIulBmIFVZt5ryqA3StGsjT5DIaR5qhvnqyExmgqL9048ov1ZLvnmYLWDrgzcM9Nl4GgYeAfsV7LKKO3RYp0rcCS0Wc4pDm_rdqOAvHGT-QiIfG12)## Projects 2019 is also a year where Link has forged new client relationships and strengthened older ones. The Pacific Community (SPC) came to us to design and develop two important health and education dashboards: pacificdata.org/education-dashboard and pacificdata.org/health-dashboard. Both dashboards add to the features of the Pacific Data Hub (www.pacificdata.org), a data portal built with great care and attention for SPC by Link Digital in 2018. We were also honoured to continue working with Cancer Australia, an Australian government organisation with a mission to diminish the impacts of cancer, address disparities and improve outcomes for those affected by cancer. Together we launched a revamped canceraustralia.gov.au website, with optimised navigation and improved user experience for all devices. Of course, we appreciate all of our amazing local and international clients. Particularly as many share the same goal we have – to bring more data into the open. We also added to our growing list of commercial, community and technology [partners](https://linkdigital.com.au/partners/) in 2019. ## Awards We were surprised and delighted to win the Emerging Exporter Category at the 2019 ACT Export Awards. Measured over the previous three years, it was no coincidence that the assessment period overlapped with the timeline of growth Link has been measuring on a weekly, quarterly and annual basis under the EOS management framework. As noted by Steven De Costa during one of our all-hands catch ups, thanks were due to both EOS and our professional team. Because, “Each solved problem has always found a home within the capable hands of someone in the company who is in the right seat, someone who is honourably taking on the basic functions of our company, and someone who is seeking to improve, maintain and mindfully nurture these functions to keep the whole organism healthy.” - ![](https://linkdigital.com.au/wp-content/uploads/2020/01/EG-ETlGUcAAI2_T-1-768x1024.jpg) - ![](https://linkdigital.com.au/wp-content/uploads/2020/01/EG-gFb2U0AA-QCu-1-768x1024.jpg) ## CKAN Stewardship It was also in 2019 when the Open Knowledge Foundation (OKF) supported the joint CKAN stewardship proposal put forward by Link Digital and Datopian. As a co-steward of the CKAN Project, it’s a privilege to work for and with an engaged and active CKAN community that is thriving. The stewardship recognises Link’s strong connection to OKF in both principle based action and specific alignment to CKAN’s mission. ![](https://lh4.googleusercontent.com/5Blutd1XKLmXYqGlAdasozzjuLF4b1DJwL-lv-wUH--kXbz1EaDKok2zgVcLjA0VJFsHTI-0EZQKhRbbQO8ZMpalsnMdXacKEpUJUULQuipiMQU2U24RHfTqvEXR9XbG0U_EJBrQ)## New Staff We were happy to see our team continue to expand globally throughout 2019. Our newest recruit is John Corlett, a Kentico Cloud Certified Developer, DSDM (Scaled Agile) Practitioner with a Diploma in Communications – Journalism and Cert IV in Small Business Management who acts as Link Digital’s liaison between the client and multidisciplinary production teams to provide digital analysis and solutions for our global clients. Link Digital’s European team was also joined by Brett Jones, located in Berlin. Brett delivers a dedicated support service to the CKAN project and is funded by Link Digital as part of our commitment as a co-steward of the CKAN project. Angela Hulford, our general manager, also had the opportunity to visit and catch up with our European team. After a quick stop over in Berlin to meet with Steven De Costa and Brett Jones, both Angela and Steven then headed east to Kharkiv, Ukraine, to thank operations team members there for the consistently excellent work they do. ![](https://linkdigital.com.au/wp-content/uploads/2020/01/try-1024x842.png)The year that has passed is a good guide to see clearly where we have been, where we currently stand and where our sights are set for tomorrow. As we say goodbye to 2019, we kickstart 2020 with continuous grit, passion, and faith that whatever we set our minds to, we can achieve. Rock on! *“Link Digital is strong now, but it is also much more self aware and much more resilient when facing challenges. We learn from the very big and the very small lessons. We are now a company which operates in a mindful manner. Our observance and consideration will continue to force us to improve and all of this is entirely every team member’s doing.”* – Steven De Costa, Executive Director of Link Digital **If you would like to contribute to the CKAN open source project, or have a project you want to discuss, feel free to get in touch with our team today.** **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [COVID-19 Update](https://linkdigital.com.au/news/2020/03/covid-19-update/) **Published:** March 24, 2020 **Author:** Steven De Costa **Content:** Action is being taken worldwide to ‘flatten the curve’ and reduce the rate at which the COVID-19 virus is spreading through population. Link Digital has taken a look at two general areas where changes in community health and economic market conditions have the potential to disrupt our regular business operations. At this stage we are confident that the change in risk factors are appropriately mitigated, or otherwise remaining steadily low. Our existing clients can rest assured that our niche CKAN hosting, support and maintenance services are not likely to be disrupted. Nor are our traditional cloud hosting and digital agency services likely to be disrupted. ## Risk to business operations: Due to social distancing measures and/or disruption to staff availability In response to the presence of COVID-19 in Australia and other parts of the world where our team members are located, Link Digital is taking practical steps to ensure our distributed and virtual teams remain available to work without disruption to normal day-to-day operations. With a remote workforce, all of our systems and processes are already designed for decentralised teams, so changes are minimal. **There will be no changes made to business hours, support response times or resource allocation.** The precautionary steps are largely being made to ensure the following: 1. Key staff processes are accurately documented and up-to-date; 2. Knowledge relating to active client contracts is captured within our internal knowledge base, as per existing operating procedures; 3. Staff are being paired between different geographic locations and undertaking project reviews to ensure further redundancy among those who are familiar with the support characteristics of each client environment. During this time we will continue to monitor the situation and follow advice from Local and Federal Governments as well as the World Health Organisation to ensure our team and clients are minimally impacted by the global pandemic. ## Risk to business operations: Due to reduced revenue opportunities Link Digital has noticed a large increase in the publishing of data related to the pandemic, both in the Open Government and Open Research sectors. While some disruption is expected for procurement processes that were based on pre-pandemic market activity, the demand for our niche services surrounding enterprise data ecosystems appears to be growing strongly. There is a rapidly emerging, global recognition that openness and collaboration are needed at this time. A small selection of COVID-19 Dataset Activity and Open Data related articles is provided below. ## COVID-19 Datasets Activity **Topic** **URL** Situation update worldwide [https://www.ecdc.europa.eu/en/geographical-distribution-2019-ncov-cases](https://data.europa.eu/euodp/en/data/dataset/covid-19-coronavirus-data/resource/4abdfc17-6225-41d1-b969-9ebbc01dc523) Tackles the availability, openness, uptake useage and dissemination of data in this pandemic Open access epidemiological data from the COVID-19 outbreak. Full-text and metadata dataset of COVID-19 and coronavirus-related research articles optimized for machine readability. COVID-19 Open Research Dataset (CORD-19) dataset of articles to help with the fight against COVID-19 Realtime COVID-19 monitoring Country-by-country coronavirus testing Country-by-country confirmed cases and deaths. Developed to provide continual, free, and updated access to COVID-19 data to create visualizations and analyses Provides daily updates on cases in the US. ## COVID-19 & Open Data Related Articles **Topic** **URL** COVID-19: Making data and models open is part of the fight against it – governments must act now Open Data Set on COVID-19 Released for Machine Learning Can AI help health care defeat COVID-19? These Bay Area groups are trying to find out. US Government reportedly in talks with tech companies on how to use location data in COVID-19 fight Accurate science communication is key in the fight against COVID-19 With launch of COVID-19 data hub, the White House issues a ‘call to action’ for AI researchers **Categories:** Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Moving Forward From Drupal 7: What’s In Store](https://linkdigital.com.au/news/2020/04/drupal-seven-eol/) **Published:** April 6, 2020 **Author:** Steven De Costa **Content:** Beginnings always signify the end of something – this holds true even on software. More than a decade after its release in January 2011, Drupal 7 will reach End of Life (EOL) on **November 2021.** If you keep up with the latest Drupal news, you know that this transition isn’t something new nor will it be the last to take place. Now that Drupal 7 EOL is set to happen, one question lingers – what’s the next step for businesses and organisations? Read on as we dive deeper into what’s in store after Drupal 7 End of Life. ## What does End of Life mean? Simply put, when a version of Drupal has reached the end of life, it means that the core maintainers of Drupal.org will no longer support the version. That being said, as of November 2021: - Drupal Security Team will cease from providing support or Security Advisories for Drupal 7 core, contributed modules, themes or other projects. - The community at large will no longer create new products, fix bugs (in existing projects), write documentation, etc. around Drupal 7. - There will no longer be core commits to Drupal 7. - Drupal core will display as unsupported on Drupal 7 sites with an update status module. - Drupal 7 might be flagged as insecure in third-party scans. - Best practices recommend not to use unsupported software so building of new Drupal 7 sites will no longer be advisable. ## Should you migrate your site right away? If your site is still running on Drupal 7, now is the perfect time to future proof your website. Website owners are advised to upgrade to Drupal 8 then migrate to Drupal 9 when it’s finally released. *But… Drupal 8 will also reach the end of life in 2021. Why bother migrating?* If Drupal 8 is also going to reach EOL in 2021, wouldn’t it be a waste of time to migrate? The short answer? No. Truth be told, Drupal 8’s innovation model is working well, some have suggested to never release Drupal 9 at all. And while that idea isn’t viable as deprecated functionality needs to be removed periodically which won’t be possible unless a new version is released, Drupal contributors emphasised that the first release of Drupal 9 will be identical to the last minor release of Drupal 8. **So fret not, migrating from Drupal 8 to 9 will be a lot easier compared to the previous major version upgrades.** ## Things to consider when migrating to Drupal 8 ### **1.** **Core and contributed modules** Before thinking of migrating to Drupal 8, it’s important that you create a complete list of core and contributed modules enabled on your Drupal 7 site. Put them in a list you can use as your basis for upgrade. Once done, make sure each module fits the following criteria: - It’s a must-have when you migrate your site to Drupal 8 - It has moved to Drupal 8 core - It has a Drupal 8 version available Note: If your enabled contributed modules don’t fit the above, it’s time to look for ones that can achieve the same functionality on Drupal 8. **1.1 Custom modules** – all of them should be ported to Drupal 8 core to implement all unique site features. ### **2. Known issues** Double check items that may need your attention when upgrading from Drupal 7 to Drupal 8. These may include: allowed vocabularies of taxonomy term reference field, blocked IPs, comment types, PHP code, text processing settings, potential ID conflicts, etc. ### **3. Available Updates** In order for you to instantly migrate configuration or content from contributed modules, you should be using their latest versions. To see if there are any available updates, navigate through **Admin**>**Reports**>**Updates**. ### **4. Drupal 8 configuration** Unlike the migration process on Drupal 7 (and earlier versions), you don’t need to have all the content types and fields ready before migrating your site to Drupal 8. The Migrate module will be the one creating the content types and fields as part of the migration process. It’s worth noting that the upgrade process is going to overwrite configuration on the Drupal 8 site so it’s a must that you **don’t configure the Drupal 8 site until the upgrade process has been completed**. Note: It’s also best not to create content or anything on the Drupal site until each of your source content has been fully imported. ### **5. Website Theme** Since Drupal 8 uses TWIG, Drupal 7 theme isn’t permitted to port directly to the updated version. There are two solutions for this: one is to update your PHP template and two, use a theme with similar layout and features supported by Drupal 8. ## Conclusion The best is yet to come for Drupal so you need not have doubts about whether or not to keep your website up-to-date with the latest version. After all, having a site that runs securely, smoothly and free from deprecated code is all that we always hope for, agree? If you have a project to discuss with us or want to learn how [Link Digital](https://linkdigital.com.au/) can help you regarding this matter, give our team a call at +61 2 6111 2907. *Sources:* **Categories:** Drupal, Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** Thought Leadership --- ### [Open Data Driving Growth and Recognition from Major Data Players](https://linkdigital.com.au/news/2020/09/open-data-driving-growth-and-recognition-from-major-data-players/) **Published:** September 9, 2020 **Author:** Steven De Costa **Content:** With news of recent open data initiatives from major technical and financial organisations we are witnessing an inflection point, with the recognition of both the commercial and social value of open data. The benefits of open data and powerful AI enabled analytics are driving investment in open data programs across the ecosystem. A few months ago Microsoft [launched](https://blogs.microsoft.com/on-the-issues/2020/04/21/open-data-campaign-divide/) their Open Data Campaign to address the looming “data divide” and help organizations of all sizes realize the benefits of data and the new technologies it powers. *“We believe everyone can benefit from opening, sharing and collaborating around data to make better decisions, improve efficiency and even help tackle some of the world’s most pressing societal challenges.”* [Closing the data divide: the need for open data](https://blogs.microsoft.com/on-the-issues/2020/04/21/open-data-campaign-divide/) Microsoft has been a late player into the open data space, but we welcome their initiative and expect this will drive a deeper understanding and adoption of open data across broader areas as more toolsets are developed to utilize open data. Our partner of many years, Amazon Web Services (AWS) has also been a regular contributor to investment and [discussion on open data](https://aws.amazon.com/blogs/publicsector/tag/open-data/), leading initiatives across numerous sectors to provide greater access and usability for the world’s largest and most significant public datasets. As witnesses to the growing recognition of the value of open data, and as stewards of open source tool sets, Link Digital has established skill sets and experience to deliver mature governance and implementation of open data platforms for our partners and clients. **Categories:** All articles, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [United States Climate Data Portal](https://linkdigital.com.au/news/2021/03/sec-to-accelerate-company-climate-data-reporting-requirements/) **Published:** March 20, 2021 **Author:** Steven De Costa **Content:** The United States Securities and Exchange Commission (SEC) responded to demand for more [climate change information](https://www.sec.gov/news/public-statement/lee-climate-change-disclosures). Questioning whether current disclosures adequately keeps investors informed. The last time the SEC issued guidance in this area was 2010, but it’s clear that investors now require more consistent and accurate data from companies. The SEC intends to drive better regulation to monitor, review, and guide climate change disclosures in order to provide more consistent, comparable, and reliable information for investors. Which opens questions around how much data and how regularly companies can or will update and share this data. The move towards greater climate reporting at company level is part of a global trend – towards the end of 2020 the UK announced its plans to mandate climate data in line with standards set by the Taskforce for Climate-related Financial Disclosure (TCFD), with regulators in New Zealand, Hong Kong, South Korea and Switzerland also setting out similar requirements. Often described as the [‘Third Wave’ of open data](https://opendatapolicylab.org/third-wave-of-open-data/), this approach adopts a more purpose-driven approach to data sharing and is part of a growing call for greater transparency at the corporate level. We celebrated the announcement of the LF Climate Finance Foundation in a [previous article](https://linkdigital.com.au/news/2020/09/ai-enhanced-open-source-analytics-and-open-data/), and the latest move from the SEC clearly builds on momentum already taking place – the great news is that robust, tried, tested and free open source tool sets already exist with platforms such as CKAN to effectively facilitate these data requirements. As leading advocates of open data, Link Digital welcomes the latest move by the SEC and, at the same time, understands that this will raise questions within organisations about how to go about the process. Having worked at the national and regional level with governments and institutions over many years, we’ve helped them to report and publish data through Climate Data Portals, Platforms and APIs, we have the experience to guide companies on how to implement and position their climate related disclosures today. Increasing transparency today will help organisations improve their climate impact credentials with both investors and analysts. Please [get in touch](https://linkdigital.com.au/get-in-touch/?gclid=CjwKCAiAoOz-BRBdEiwAyuvA62ZSLAx6ks1d9JiWSOXqE63wgBKZVP1CXjPyU9ZfqsVnWUJlXgIkNhoC8ucQAvD_BwE) if you’re interested in discussing how we can help. **Categories:** Environmental/Climate Change, Government, Steven De Costa, Thought Leadership **Tags:** climate data, corporate data, Thought Leadership --- ### [Happy Earth Day from Link Digital](https://linkdigital.com.au/news/2021/04/happy-earth-day/) **Published:** April 22, 2021 **Author:** Steven De Costa **Content:** As we celebrate [Earth Day](https://www.earthday.org/) today it’s refreshing to see so many companies joining the commitment to zero carbon and more. With many now targeting 2030 it’s encouraging that the world’s leading brands such as Apple, Amazon, Nike, Virgin and others are making these commitments. The route to delivering on these commitments is to publish regular and transparent data openly so that the companies can also be held to public scrutiny. Our experience working with governments has shown that publishing data openly promotes ‘good behaviour’ within the organisations themselves. Along with recent [SEC recommendations](https://linkdigital.com.au/news/2021/03/sec-to-accelerate-company-climate-data-reporting-requirements/), we note that there is a growing impetus towards what is often described as the [‘Third Wave’ of open data](https://opendatapolicylab.org/third-wave-of-open-data/). This approach follows a more purpose driven direction toward data sharing and is part of a growing call for greater transparency at corporate level. Have a happy Earth Day **Categories:** All articles, Environmental/Climate Change, Open Data, Steven De Costa, Thought Leadership **Tags:** climate data, corporate data, open data, Thought Leadership --- ### [Vietnam Team Kicks Off with CKAN Training](https://linkdigital.com.au/news/2021/04/vietnam-team-kicks-off-with-ckan-training/) **Published:** April 23, 2021 **Author:** Steven De Costa **Content:** We’re pleased to share an update on our new operations team in Vietnam and the great progress we’ve made towards developing CKAN Training services. New members Thanh, Rico, Hy and Hieu started with Link Digital this year and together form the core of our Vietnam based development and operations team. Sergey Motornyuk, our lead developer, has developed and delivered our CKAN Training Program to the new Vietnam team members. ![Vietnam Team Kicks Off with CKAN Training](https://linkdigital.com.au/wp-content/uploads/2021/04/Vietnam-Team-1024x536.png)From Left: Thanh, Rico, Sergey, Hy and HieuThanh is Vietnam lead and DPM, with Hy and Hieu delivering development and Rico running DevOps engineering from our site in Ho Chi Minh City, Vietnam. The team has completed two months of practical training and are now working a ‘buddy system’ with our established teams. Thanh has been on board since the start of the year and is already fully engaged with clients and product owners Link Digital’s training program for CKAN has been in development since last year and we plan to make the course available to developers and DevOps Engineers interested in building their own knowledge and expertise as a CKAN developer or platform maintainer. The CKAN course modules will continue to be refined over the rest of this year but please get in touch if you would like to [learn more about our CKAN training options](https://linkdigital.com.au/get-in-touch/). From all reports our new team members in Ho Chi Minh City have really enjoyed having Sergey on site to fast track their learning on CKAN. ![](https://linkdigital.com.au/wp-content/uploads/2021/04/Vietnam-Team-Meal-3-scaled-768x1024.jpg)![](https://linkdigital.com.au/wp-content/uploads/2021/04/Vietnam-Team-Meal-2-scaled-768x1024.jpg)![](https://linkdigital.com.au/wp-content/uploads/2021/04/Vietnam-Team-Meal-1-scaled-1024x768.jpg)![](https://linkdigital.com.au/wp-content/uploads/2021/04/Vietnam-Team-Meal-scaled-768x1024.jpg)![](https://linkdigital.com.au/wp-content/uploads/2021/04/Vietnam-Team-Meal-4-scaled-1024x769.jpg) **Categories:** All articles, CKAN, Open Data, Steven De Costa, Thought Leadership, Tutorial **Tags:** CKAN Training, Thought Leadership, Vietnam --- ### [Link Digital Stands with our Team in Ukraine](https://linkdigital.com.au/news/2022/02/link-digital-stands-with-our-team-in-ukraine/) **Published:** February 27, 2022 **Author:** Steven De Costa **Content:** Update: 21 June Due to the exceptional dedication of our Ukraine team Link has continued to deliver work for our client’s without any dip in productivity. We have filled an additional three technical roles within the company over the last four months, and today we also welcomed a dedicated human resources manager into the team. Update: 9 March At this time our team members are all in the process of relocating to safer locations within Ukraine or have completed such relocations. Despite the most existential set of challenges, our team’s productivity remains high and disruption to work in progress remains minimal. We appreciate the patience and understanding of our clients over the past two weeks. Original Post Seven members of our amazing team are based in conflict zones within Ukraine. This is a difficult situation and this is what we have done: - Established a safe house for the team in Poland. - Organised an emergency support payment for each team member. - Committed to stand ready to support them, whatever they might need. As a company we can not control what is happening in the areas where our team members live, Kharkiv and Odessa, but we can control how we respond to the situation. Our response will always be to support our team. This response may have impacts on our clients and we will work collaboratively with them over the weeks and months ahead to keep them informed regarding our capacity to deliver and timeframes for doing so. This is our standard operating process, so nothing is changing in this regard. All of our managed services remain supported. There is no diminished capacity regarding our hosting and support capabilities. As a company, Link Digital recognises that our team in Ukraine needs support and this is not something we will walk away from. We will keep all of our Ukraine staff employed and paid, no matter how many story points they are able to deliver. For many years this company, and all of our clients, have benefited from the amazing talent of Ukraine’s IT professionals. We have developed strong bonds of trust, respect and friendship with Ukraine. We will not walk away, we will stand and support our team. Our company’s response to the situation in Ukraine may have some impact on our clients. Our client’s may need to be more patient, they may even need to cover some additional costs for new options that will complete project work and provide the resourcing for new projects. However, these are matters which Angela and myself can manage. These are matters which our product owners, Iaroslav and Rupak, can manage. These are matters which Phil, Taleatha, Joel and others in our team can manage. What Link Digital will not do, is put the burden of managing the impact of conflict back onto our team members in Ukraine to manage. ![Link Digital Team in Kharkiv, 2019](https://linkdigital.com.au/wp-content/uploads/2021/12/Team-1024x768.jpg)Link Digital Team in Kharkiv, 2019 **Categories:** Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** Thought Leadership --- ### [Congratulations to Brett on joining the CKAN Tech Team](https://linkdigital.com.au/news/2022/03/congratulations-to-brett-on-joining-the-ckan-tech-team/) **Published:** March 14, 2022 **Author:** Steven De Costa **Content:** Link Digital takes pride in announcing that our DevOps Engineer and CKAN Contributor Brett Jones [@kowh-ai](https://github.com/kowh-ai) will be joining the CKAN tech team. Based in Berlin, Brett has worked with consistent and concerted effort for Link Digital for the last two years. Throughout this time he has been regularly involved in the CKAN community and made a number of contributions to CKAN, predominantly in the DevOps area. Brett is a world of knowledge and by fostering a culture of collaboration, we are excited to see Brett extend his contribution to the CKAN tech team whilst continuing to deliver his expertise and commitment to Link Digital. His commitment is highly commended; we recognise his achievements and encourage his growth within the open data community. **Categories:** Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** Thought Leadership --- ### [Celebrating 20 Years of Link Digital](https://linkdigital.com.au/news/2022/06/celebrating-20-years-of-link-digital/) **Published:** April 11, 2022 **Author:** Steven De Costa **Content:** 2022 is a huge year for **Link Digital**, marking our **20th anniversary** as a company – and 20 years of outstanding outcomes for our customers. It’s been an incredible journey since 2002, when Link Digital launched as a small but passionate startup in Australia. Now in 2022, we are an enterprise-grade agency with a presence in five cities around the world and an internationally recognised workforce of digital engineers from across the globe. **In 20 years of Link Digital,** we’ve evolved toward a vision of creating meaningful change in the world of open data. We are proud to have implemented scores of open data solutions for government, commercial and non-profit clients internationally. Today, our combination of CKAN data management expertise and agile methodologies makes us the go-to supplier for projects ranging from data management to custom web solutions. To celebrate our 20 year milestone, we’re sharing some key achievements we are proud of. We hope you enjoy this short history of 20 Years of our favourite Link Digital moments, as much as we enjoyed putting it together! ## 20 Years of Milestones **2004/2005 –** Our website developed for the Australian War Memorial, KidsHQ, was recognized as a finalist in two categories of the Australian Interactive Media Industry Association Awards. **2007/2008 –** Australia’s National Portrait Gallery presented its first ever online exhibition *Animated*. This highly original exhibition broke new ground in Australia and Link not only developed the exhibition website but provided valuable input and support for the National Portrait Gallery, from inception through delivery. We were responsible for developing all related branding and promotional materials. **2013-2015 –** Link Digital established itself as an enterprise-level architecture and support services for CKAN, while concurrently creating the opportunity to expand services for a global approach to the market. **2017 –** The majority of high profile CKAN projects in Australia are now being managed by Link Digital. Link Digital is a respected and prominent CKAN project contributor, with staff holding leadership roles in project governance, the technical team, community and communications team. **2018 –** Reflecting the truly international nature of the open data sector, Executive Director relocates to Berlin with assistance from the Australian Landing Pad program to grow the company profile in Europe. Link Digital wins initial contracts with LEGO Group and Norway Roads Administration. **2019 –** Link Digital receives global recognition via appointment as co-steward of the CKAN project. We also win the Emerging Exporter category of the ACT Chief Minister’s Export Awards. And, we become a co-steward of the CKAN project. **2020-** Link Digital expands the Partner Program to include open data consultants who work in areas such as data governance and data quality, expanding our capability to be the prime contractor on engagements that begin with such service requirements. **2021/2022-** Link Digital begins to expand its managed services to include Microsoft Azure infrastructure, building on almost 10 years of experience in AWS services. We also won the Professional Services category of the ACT Chief Minister’s Export Awards. ![20 Years of Link Digital](https://linkdigital.com.au/wp-content/uploads/2022/06/Pizza20Updated-8d6375d1-4e87-4637-a055-13ece1fa4c05-1-1024x862.jpg)## 20 Years of Partnerships Link Digital has partnerships spanning Australian and international customers. Our commercial partner program matches specialist CKAN hosting, support and integration services to our clients’ needs. Currently, we host and support 15 CKAN portals for clients from Australia, New Zealand, South Pacific, Europe and North America, support 7 portals in NSW, 4 State-level portals in Australia and support 51 Amazon Marketplace customers. We thank all our clients for their 20 years of ongoing support. ## 20 Years of Highlights Link Digital have partnered up with many government agencies and organisations to create meaningful change. Here are some of our favourite projects. ![](https://linkdigital.com.au/wp-content/uploads/2022/06/Screen-Shot-2022-06-02-at-11.04.35-pm.png) Link Digital worked together with Cancer Australia to implement a significantly improved user experience journey. One of the main goals for this project was to simplify the complicated and confusing main navigation. Another priority was to improve navigation between the main site and the mini-sites. ![](https://linkdigital.com.au/wp-content/uploads/2022/06/Screen-Shot-2022-06-02-at-11.04.41-pm.png)In 2018, the Pacific Community (SPC) came to us to design and develop two important health and education dashboards. Both dashboards add to the features of the Pacific Data Hub, a data portal that was purpose-built for SPC by Link Digital. ## 20 Years of Awards & Recognition Link Digital has a long list of accolades and has contributed to many milestone developments within the open information technology space. These achievements are truly a recognition of the entire team at Link Digital. Our awards and recognitions include the prestigious 2005 Museums Australia Print and Design Award and Emerging Exporter Award in the 2019 ACT Export Awards. Finalist: 2004 AIMIA Awards for our work with the Australian War Memorial 2005 Museums Australia Print and Design Award. 2019 Emerging Exporter Award, 2019 ACT Export Awards. 2021 Professional Services Award, 2021 ACT Export Awards. ## 20 Years of Teamwork The Link Digital team has grown from a “lean” startup led by Managing Director Steven Costa to a dynamic global workforce with team members working remotely across five international locations. With the valued support of key team anchors, the last 20 years have been inspired by our vision and values. We aim to *create meaningful change* and to stay true to our core values of Creativity, Team, Results, Honesty, and Mastery. With a distributed team that work across timezones to support distributed clients, we value a creative approach and use smart tools, from Zoom to Jira, that get results. Above all, we value teamwork and think we have the best team in the open data sector! ![Link Digital Team in Kharkiv, 2019](https://linkdigital.com.au/wp-content/uploads/2021/12/Team-1024x768.jpg)Link Digital Team in Kharkiv, 2019 **Categories:** Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** Thought Leadership --- ### [April 2022- CKAN Monthly Live](https://linkdigital.com.au/news/2022/05/april-2022-ckan-monthly-live/) **Published:** May 12, 2022 **Author:** Steven De Costa **Content:** Did you miss out on our recent CKAN monthly live? Not to worry! We’ve got the recording right [here!](https://www.youtube.com/watch?v=oeWKdQsAdJA) CKANMonthlyLive: Steven De Costa announced the next steps for CKAN. Over the next 8-week, we will be working closely with our Product Manager to help shape CKAN 3.0! This is an exciting time for the project, and we look forward to The CKAN 3.0 product vision coming together! Check it out to see what happened and how you can shape the vision. The slide deck for the presentation can be found here: [https://docs.google.com/presentation/d/14volOCJVav\_Hp8BfFG3DYwBENoFX0k0RowtfdU8hNGY/edit?usp=sharing](https://docs.google.com/presentation/d/14volOCJVav_Hp8BfFG3DYwBENoFX0k0RowtfdU8hNGY/edit?usp=sharing) Best wishes, The Link Digital Team **Categories:** CKAN, Open Data, Steven De Costa, Thought Leadership **Tags:** #ckan3.0, CKAN, opendata, Thought Leadership --- ### [We are pleased to be featured on the Open Data Institute website!](https://linkdigital.com.au/news/2022/08/we-are-pleased-to-be-featured-on-the-open-data-institute-website/) **Published:** August 19, 2022 **Author:** Steven De Costa **Content:** **Check out the article [here.](https://theodi.org/service/membership-networking/?utm_campaign=ODI%20Membership&utm_content=218206482&utm_medium=social&utm_source=twitter&hss_channel=tw-534255106#1660660636921-87c0ae59-d020)** We believe in the power of open source software and principles, and we are a champion for the world’s leading open source platform for open data. We are committed to bringing the value of open data to users worldwide. Our success as a company is due to our dedication to serving the greater community – a community we will continue to serve and grow with. **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** CKAN, open data, Thought Leadership --- ### [Beyond Digital — NSW's digital strategy](https://linkdigital.com.au/news/2022/08/beyond-digital-nsws-digital-strategy/) **Published:** August 23, 2022 **Author:** Steven De Costa **Content:** The NSW Government is committed to using data to drive better outcomes for the people and businesses of the state. [The Data Strategy](https://data.nsw.gov.au/nsw-government-data-strategy) sets out a collaborative, coordinated and safe approach to using and sharing data across government. This will ensure that decisions are informed by the best possible insights, leading to improved outcomes for all. This Data Strategy forms Phase 2 of the NSW Data Reform and the statutory review of the *Data Sharing (Government Sector) Act 2015* forms Phase: 1. Phase 1: embed data practices to deliver data-driven insights during COVID-19 pandemic 2. Phase 2: develop and launch a new data strategy 3. Phase 3: review the NSW Data Sharing Act 2015 Data is essential for effective decision-making, especially in times of crisis. The COVID pandemic, bushfires, and floods have shown how important data sharing and collaboration are for solving problems. Data governance and security are also crucial for protecting data and maximising its value. The NSW Data Strategy outlines how to best use data to respond to these challenges. By improving data sharing and collaboration among departments and agencies, we can make better decisions that protect people and property. The strategy also provides guidance on appropriate data governance and security measures to ensure that data is used effectively and protected from misuse. ##### **The Vision** The NSW Government is committed to using data to improve outcomes for the community. Collaborating on data use and sharing will ensure that data is used consistently and safely to inform decision-making. This will aim to accelerate actionable insights, treat data as an asset, strengthen transparency and trust, and foster culture, leadership, and capability. ##### **Accelerating actionable insights** The government needs to be able to make decisions quickly and efficiently, especially in emergency situations. To do this, they need access to actionable insights that can help inform their services, policies, and programs. We can help by establishing ways of working that accelerate our ability to safely bring together data from trusted sources, generate richer insights more quickly, and make them available to decision-makers through self-service and user-friendly data products. [The Spot app ](https://linkdigital.com.au/project/the-act-esa-single-point-of-truth-spot-app/)is the perfect example of how to go from data to actionable insight. With just one click, the app sends automated ESA news alerts to relevant departments, stakeholders and journalists, allowing the community to be informed of warnings in near real-time. This purposeful research experience results in relevant data and information that leads to more actionable insights. ##### **Treating data as an asset** Data is a critical asset for any organisation, and it is essential that we understand its value, protect it effectively, and invest in it strategically. The data strategy aims to help the NSW government recognise data as a valuable state asset, align on standards and practices to improve usability and value, develop de-identified enduring data assets that bring together data from across the government, and create a spend category for government procurement of data and data services. By taking these steps, it will ensure that data is used more effectively to solve problems and improve decision-making. As data portals continue to evolve, it is becoming increasingly important to ensure higher levels of interoperability between them. This not only provides more value to end users but also strengthens the ecosystem as a whole. The NSW Government has already taken steps to ensure this by mapping the latest [ANZLIC endorsed version of ISO19115](https://linkdigital.com.au/news/2022/06/iso19115-geospatial-metadata-mapping-and-validation-with-ckan/) for CKAN-based data portals and providing a complimentary validator. This allows our clients to register and validate geospatial datasets on three of the NSW Government portals we support. ##### **Strengthening transparency and trust** Data governance is a complex and ever-evolving issue. The strategy outlines the need for data to be collected, managed, used, and shared in accordance with the highest privacy, security, and ethical standards, it must be transparent and trustworthy. This means taking a ‘by design’ approach to data projects, assessing privacy, security, and ethical impacts at every stage, and aligning with community expectations. It also means consolidating the whole government data policies to enable the safe use and sharing of data across all levels of government, including engaging with the Aboriginal Community to implement [Indigenous Data Sovereignty ](https://aiatsis.gov.au/publication/116530)and Indigenous Data Governance principles. ##### **Fostering culture, leadership, and capability** The NSW Strategy recognises that people need to be able to use data effectively and safely in order to make decisions that impact the community. To this end, they will foster strong data leadership through the Chief Data Officers (CDOs) and the NSW Data Leadership Group (NDLG). This will include CDOs leading the development of Data Roadmaps for their departments and the NDLG conducting a maturity assessment across the sector to determine baseline data literacy and capability. With this information, areas can be prioritized for improvement in order to build a more capable sector. The Project Link Digital worked on for the [Department of Planning, Industry and Environment ](https://www.dpie.nsw.gov.au/water/home)(DPIE) is a prime example of fostering culture, leadership and capability by developing policies and clear lines for leadership and accountability for water data. The NSW Chief Scientist and Engineer was asked to review and advise on the adequacy of water-related data collections, infrastructure, and capabilities to meet current and future requirements and manage associated risks. **Categories:** All articles, Government, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [Congratulations Link Digital on becoming a finalist at ARN Innovation Awards](https://linkdigital.com.au/news/2022/08/congratulations-link-digital-on-becoming-a-finalist-at-arn-innovation-awards/) **Published:** August 30, 2022 **Author:** Steven De Costa **Content:** *ARN* is proud to announce the finalists of an enhanced *Innovation Awards* in 2022, housing a record-breaking number of submissions in what will be the largest celebration of ecosystem excellence in delivering transformative customer solutions across Australia. Representing the entire Australian ecosystem, 354 finalists (including 120+ individuals) make the shortlist from a pool of over 200 organisations and more than 480 nominations, spanning partner, start-up, telco, vendor and distributor businesses. “*ARN* congratulates **Link Digital** on becoming a finalist in the Australia-wide Innovation category,” said Cherry Yumul, Vice President of Channel at Foundry. “This is a stunning statement from the market. Irrespective of ongoing societal challenges and worsening economic conditions, Australia continues to power forward unperturbed — the ecosystem has once again raised the bar to set new levels of innovation. “Enormous credit to the market-leading companies and individuals continuing to press ahead in helping customers innovate at pace – despite the notable difficulties – which once again demonstrates the depth of transformation taking place across the country. Congratulations Link Digital, nothing can stop your pursuit of excellence.” In 2022, *Innovation Awards* will honour the channel across eight categories, spanning Partner Innovation, Tech Innovation, Australia-wide Innovation, Start-up Innovation, Personal Innovation, Vendor Innovation, Distributor Innovation and Hall of Fame. In streamlining the program, the aim is to increase focus on the pacesetters of the local market, those revving up the innovation engine and powering ahead in the delivery of transformative solutions and services. Reflective of a diverse technology network, finalists range from large-scale multinational consultancy firms to emerging start-ups, alongside leading system integrators, managed service providers and solution consultants, plus cloud specialists, independent software vendors, boutique agencies and application developers. This is in addition to channel-centric vendors, telecommunications providers and supply chain experts. Within this standout group, finalists are located across the entire country and represent all states and territories, spanning New South Wales, Victoria, Queensland, Australian Capital Territory (ACT, South Australia, Western Australia, Tasmania, and Northern Territory. Collectively, *Innovation Awards* in 2022 stands tall as the leading forum for setting the industry benchmark for ecosystem excellence across Australia. The winners will now be selected by an executive panel of industry judges – acknowledging creativity, innovation, and excellence – before being announced at a celebration dinner at ICC Sydney on Thursday 15 September. **Additional information:** **ARN article:**[ https://www.arnnet.com.au/article/700770/arn-innovation-awards-2022-finalists](https://www.arnnet.com.au/article/700770/arn-innovation-awards-2022-finalists) **ARN Innovation Awards website:**[ https://www.arnnet.com.au/innovation\_awards/](https://www.arnnet.com.au/innovation_awards/) **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** arn, awards, finalist, Thought Leadership --- ### [Data Tech Stack Audit](https://linkdigital.com.au/news/2022/09/as-data-becomes-increas/) **Published:** September 27, 2022 **Author:** Steven De Costa **Content:** As data becomes increasingly important in our world, it is more important than ever for people to be collaborative and participatory in their fields Doing so allows access to new ways of assessing problems and finding targeted interventions. Data-driven engagement is enhanced collaboration that produces more successful outcomes. If you’re looking to get your organisation to work with data more collaboratively, it’s important to understand how everyone currently works with data. We’ve created a survey form template to help you understand how each team uses data. [ Data Tech Stack Audit Survey ](https://mcusercontent.com/865b0a3e7d21cd338fc74a64e/files/1ca6edf2-4811-d3c0-7ba3-3fafa5d08436/Survey_Template__Data_Tech_Stack_Audit.pdf) If you or your organisation want to learn more about making data available for analysis efficiently and safely, please contact our Account Manager,[ Phil Anderson](https://www.linkedin.com/in/phil-anderson-52083418/) or simply send us an enquiry [here](https://linkdigital.com.au/get-in-touch/), and one of our experts will get in touch. *The Link Digital Team* **Categories:** All articles, Government, Open Data, Steven De Costa, Thought Leadership **Tags:** data, open data, opendataaudit, techstack, Thought Leadership --- ### [Executive Director to speak at the Canadian Open Data Summit 2022](https://linkdigital.com.au/news/2022/10/executive-director-to-speak-at-the-canadian-open-data-summit/) **Published:** October 14, 2022 **Author:** Steven De Costa **Content:** In just a few short years, the [Canadian Open Data Summit](https://www.opendatasociety.ca/) has become one of the most important events for anyone involved in data management. This year’s edition will be especially noteworthy as it marks the return to in-person events after years of pandemic-induced virtual gatherings. The summit will take place in Whitehorse, Yukon, on November 7th and 8th. This year’s event will focus on Unique experiences, insights and successes with Canada’s Open Data Community as a whole. [Link Digital’s](https://linkdigital.com.au/) own Executive Director, [Steven De Costa](https://www.linkedin.com/in/stevendecosta/) will be giving a talk on [CKAN](https://ckan.org/), the world’s leading open source data management system. [The Government of Canada’s open data portal](https://open.canada.ca/en) uses [CKAN](https://ckan.org/) as their data management solution, with tens of thousands of datasets making Canada’s governmental data more accessible to everyone. On the 7th of November, you have the chance to hear what’s brewing at [CKAN](https://ckan.org/) straight from the horse’s mouth. This will be a good time to learn about the steps taken by [CKAN](https://ckan.org/) and [Link Digital](https://linkdigital.com.au/) to re-think its roadmap, as well as the obstacles they faced along the way. He’ll also describe the plans for the future of [CKAN](https://ckan.org/) and how it sees its role within the Open Data Community. This year’s summit promises to be insightful, with focus areas such as Professional Development in Open Data, Indigenous Data Sovereignty, Open Data on the Front Lines of Climate Change, Innovation, Entrepreneurship and Economic Development. So if you’re interested in open data or open government, this is an event you won’t want to miss! [Reserve your spot here!](https://opendatasummit.ca/) **Categories:** All articles, CKAN, Environmental/Climate Change, Government, Open Data, Steven De Costa, Thought Leadership **Tags:** #canadiangoverment, canadianopendatasummit, CKAN, opendatasummit, opengovernment, Thought Leadership --- ### [2022 - Year in Review](https://linkdigital.com.au/news/2022/12/year-in-review/) **Published:** December 23, 2022 **Author:** Steven De Costa **Content:** As we say goodbye to 2022 and look ahead to 2023, we wanted to take a moment to reflect on Link Digital’s accomplishments over the past year and, with immense gratitude, give thanks to the amazing clients, staff and CKAN community members who have continued to define this company’s purpose. Thank you! This year we celebrated our 20th year anniversary and continued to grow with new people, new projects and expanding opportunities. Our team of digital engineers implemented open data solutions for clients around the globe, helping to create meaningful change with open data. As we move into 2023, we remain committed to our mission and look forward to continued growth and success. Here are just a few of our favourite Link Digital moments from 2022: ### CKAN Stewardship Link Digital funded [Alex Gostev](https://www.linkedin.com/in/alexgostev/) to provide additional care for one of the key foundations on which our company stands – [CKAN](https://ckan.org). Throughout this year, Alex conducted global user research by interviewing across 17 countries, made three presentations around product strategy, delivered frequent reports to the CKAN community and held more than 30 open-office meetings with our executive director and CKAN project co-steward, Steven De Costa. Alex has become an active contributor within the CKAN project, facilitating an ongoing product discussion where every community member will be heard. Link Digital is proud to have brought Alex into the CKAN community and we wholeheartedly support his commitment to nurturing and improving CKAN. Furthermore, [Brett Jones](https://www.linkedin.com/in/brett-jones-49369b8/), our Germany-based DevOps engineer became the second of our team members to be appointed as a core technical team member of the CKAN project, after providing long-term technical support to the community. Great work, Brett! ### Our Staff **New hires** In 2022 Link Digital expanded at a significant rate. In the past 12 months we’ve added five new roles (including a marketing manager, human resource manager and a new CEO), enabling quicker development of our products, systems and services for both our long-term and recently on-boarded clients. ![](https://linkdigital.com.au/wp-content/uploads/2022/12/Link-Digital-3-1024x548.png)### Our Impact We’re excited to have returned to in-person events this year, exhibiting at great conferences like [Digital NSW](https://publicsectornetwork.com/event/digital_nsw_2022/), IXSummit, and Innovate Australia. Link Digital received excellent customer feedback from attending these events, and we’re eager to keep up the momentum in 2023. In November, [Steven De Costa](https://www.linkedin.com/in/stevendecosta/) delivered three presentations for the [Canadian Open Data Summit](https://opendatasummit.ca/). These covered CKAN 101, the state of open data in Australia and varied case studies to inspire best-practice implementations of CKAN. --- This year we were excited to sponsor the Pacific #DataViz Challenge 2022. The competition sought to inspire entrants to bring the power of data visualisation to life. We sponsored the winning prize of 1,000 Euro this year and would like to [congratulate Artème Pointel from New Caledonia](https://www.youtube.com/watch?v=lxtOSbk8Ecg) for their winning entry. --- Throughout the entire year, our product owners have worked across the globe to understand, envision and deliver solutions for our clients. As a virtual team we’ve run many of our workshops and working ceremonies via video calls, so it was something of a treat for [Iaroslav Pereiaslovets](https://www.linkedin.com/in/iaroslav-pereiaslovets-a9053258/) to attend a significant customer-led workshop in London this month. After a successful series of workshops, the backlog development and release planning for 2023 work is well underway. ### Awards In August, we were named a [finalist](https://linkdigital.com.au/news/2022/08/congratulations-link-digital-on-becoming-a-finalist-at-arn-innovation-awards/) for the Australia-wide Innovation award in the 2022 #ARN Innovation Awards. This award recognises our team’s dedication to providing market-leading technology consulting and implementation services. We are proud to be recognised as an industry leader and will continue striving to provide innovative solutions for our clients. ### Recognition This year, we joined up as corporate members of [The Open Data Institute (ODI) ](http://theodi.org)– a network of organisations and individuals committed to solving similar challenges and staying up to date with data policy, news, events and innovations. We’re proud to be an important voice in championing open data practices and were fortunate enough to have our work [profiled](https://theodi.org/service/membership-networking/?utm_campaign=ODI%20Membership&utm_content=218206482&utm_medium=social&utm_source=twitter&hss_channel=tw-534255106#1660660636921-87c0ae59-d020) by ODI this year. We’re grateful to have been recognised by ODI as an important voice in the open data movement. Our innovative work aligns with our mission, and it’s great to see it being shared on their website for the wider open data community. ### Projects We’re proud to have worked on some amazing projects that have made a real difference this year. Our strong relationships with clients and government agencies have been key to our success in 2022. Some the fantastic projects from the past year include [CKAN portals for customers](https://linkdigital.com.au/case-studies/) from Australia, New Zealand, South Pacific, Europe and North America. We now support seven portals in NSW alone, 5 State-level portals across Australia and over 50 CKAN environments worldwide. It is not just government organisations that benefit from our services. This year Link Digital worked with an increasing number of Universities and Non Profit organisations on their public data programs. The [Canadian Watershed Information Network](https://linkdigital.com.au/project/canadian-watershed-information-network-canwin/) was a stand-out project this year. Climate change is one of the most pressing issues facing our planet today and Link Digital is proud to have been involved in a project that aims to help people become better informed about this complex challenge and make informed decisions to protect our environment. [The Canadian Consortium for Arctic Data Interoperability (CCADI)](https://ccadi.ca/canadian-consortium-arctic-data-interoperability) data provides insights into how climate change affects different areas of our globe, what data gaps exist, and how we can manage human activities to minimise harm to ecosystems. This information is vital for developing effective policies to combat climate change. We are excited to have played a role in this important project! ### Link Digital’s Ukrainian team Since 2013, our company has operated with a highly skilled development team in Kharkiv, Ukraine. Since the February 2022 Russian invasion of Ukraine, we’ve worked hard to support them. We are extremely grateful for our Ukrainian employees’ ongoing courage, resilience and inspiring spirit. If you would like to [share your own support with Ukraine then United24 is a great place to do that](https://u24.gov.ua/). ### Farewell to our General Manager We’re excited to announce that our General Manager, Angela Hulford, will be going on maternity leave on December 23, 2022. Today! Angela has been with Link Digital for 12 years and has been instrumental in Link Digital’s growth during that time, assuming many different roles across multiple departments throughout the organisation. She’ll be much missed — but wow, what incredible news! We don’t need to miss her for long, though — we will have Angela return in January 2024 as our new Head of Finance! Until then, we wish her a healthy and happy pregnancy, Angela — congratulations again. Thanks for everything! ![](https://linkdigital.com.au/wp-content/uploads/2022/12/Screen-Shot-2022-12-19-at-12.15.43-pm-1-298x200.png)As we look back on 2022, it’s clear to see how far we’ve come and what we’re capable of achieving. As we enter into 2023, we’ll do so with determination and enthusiasm for all that lies ahead. Here’s to a great year full of possibilities! *“It has been an honour to join the Link Digital team this year. Link Digital is not only strong but also very aware and resilient in the face of challenges. The commitment to create meaningful change will continue to propel us forward, thanks to our amazing team members.* *2023 is going to be an incredible year for Link Digital.”– [Marc Evans, CEO of Link Digital](https://www.linkedin.com/in/mrmarcevans/)* **Categories:** All articles, Steven De Costa, Thought Leadership **Tags:** Thought Leadership, year in review --- ### [Open Data Day 2023: A Full Week Celebrating the Power of Open Data](https://linkdigital.com.au/news/2023/03/open-data-day-2023-a-full-week-celebrating-the-power-of-open-data/) **Published:** March 3, 2023 **Author:** Steven De Costa **Content:** [Open Data Day 2023](https://opendataday.org/), an annual event that celebrates the benefits of open data and promotes its availability and use for solving real-world problems, this year is set to take place not just one day but during one week from Saturday, March 4th to Friday, March 10th, 2023. Organised by the global open data community, supported and sponsored by the [Open Knowledge Foundation (OKFN)](https://okfn.org/), [Open Data Day](https://opendataday.org/) is an opportunity for individuals, groups, and organisations to come together and showcase the power of open data through a range of activities such as hackathons, workshops, webinars, data expeditions, and more. In 2022, more than 150 events were organised and self-managed by the community. The theme for this year’s [Open Data Day](https://opendataday.org/) is “Open Data to AI”, highlighting the potential of open data in driving the development of AI and the importance of ethical considerations in developing and deploying AI. With the growth of AI, open data is becoming increasingly important to enable the development of new AI applications that can drive positive change in the world. The 2023 events will try to answer key questions such as “How has AI been used or can be used to tackle world-pressing issues?” or “How can open data and AI illustrate the urgency in various subcategories like climate change, budget transparency, ownership, mapping, and many more. Each year, small mini-grants are allocated to selected winners to support their organisation in hosting an Open Data event. [Link Digital](http://linkdigital.com.au) was honoured to sponsor this year’s Open Data Day(s) 2023 Small Grants Program and [congratulate the winners!](https://blog.okfn.org/2023/03/01/winners-open-data-days-2023-small-grants-programme/) To learn more about local events worldwide and how you can get involved, visit the official website at . Join us from March 4th, 2023, to celebrate the power of open data and its potential to drive positive change in the world. **Categories:** All articles, Amazon Web Services (AWS), CKAN, Government, Open Data, Steven De Costa, Thought Leadership **Tags:** #BetterTogetherThanAlone, OKFN, open data, open data day, OpenDataToAI, Thought Leadership --- ### [CKAN 2.10 is now available on AWS Marketplace](https://linkdigital.com.au/news/2023/04/ckan-210-is-now-available-on-aws-marketplace/) **Published:** May 5, 2023 **Author:** Steven De Costa **Content:** Link Digital is thrilled to announce that the highly anticipated [CKAN ](https://ckan.org/)2.10 is now available as a free Amazon Machine Image (AMI) on the[ AWS Marketplace](https://aws.amazon.com/marketplace/pp/prodview-c4ixxnzm7agby). As co-stewards of the [CKAN ](https://ckan.org/)project, Link Digital has been providing free and open-source [CKAN](https://ckan.org/) images through the [AWS Marketplace](https://aws.amazon.com/marketplace/pp/prodview-c4ixxnzm7agby) since early 2014, resulting in hundreds of successful installations worldwide. [CKAN](https://ckan.org/) 2.10 comes with some exciting new features and improvements, including: 1. Built-in CSRF protection: [CKAN](https://ckan.org/) 2.10 now incorporates built-in CSRF protection to help prevent attacks. This may affect how extensions define forms, so reviewing the necessary changes is important. 2. Refactored authentication system: The authentication system in [CKAN](https://ckan.org/) 2.10 has been completely refactored to use Flask-login, making it easier to maintain and simplify the process. Site maintainers should check the Migration notes to learn more about this change. 3. Configuration declaration: With the new configuration declaration, it is now much easier to track, validate, and define default values for all the configuration options a [CKAN](https://ckan.org/) site uses. 4. Signals system: The new Signals system allows plugins to easily subscribe to events emitted by [CKAN](https://ckan.org/) and define their own. 5. Bootstrap 5: The frontend templates in [CKAN](https://ckan.org/) 2.10 have been migrated to Bootstrap 5 to keep in line with the latest improvements on this popular framework. 6. New CLI commands: [CKAN ](https://ckan.org/)2.10 also comes with several new CLI commands, including ones to manage API tokens and the search index and [CKAN](https://ckan.org/) shell to help debug issues quicker when developing [CKAN](https://ckan.org/) extensions. 7. [Docker Compose](https://github.com/ckan/ckan-docker) setup: [CKAN](https://ckan.org/) 2.10 now includes a brand new [Docker Compose ](https://github.com/ckan/ckan-docker)setup to help users get up and running quickly with [CKAN](https://ckan.org/). These are just some highlights of the new features and improvements in CKAN 2.10. It’s always a good idea to review the comprehensive list of changes in the [CHANGELOG](https://docs.ckan.org/en/2.10/changelog.html) before upgrading to ensure that any existing systems or customisations are compatible. To simplify the installation process and help users set up [CKAN](https://ckan.org/) rapidly and effectively, Link Digital has created a series of [step-by-step installation videos](https://www.youtube.com/@link-digital/videos) and [extension installation videos](https://www.youtube.com/@link-digital/videos) for DataStore and DataPusher available on our [YouTube channel](https://www.youtube.com/@link-digital). These comprehensive videos guide users through each stage of the installation process, making it easy to follow along and complete the installation successfully. If you find these videos helpful and would like to see more [CKAN](https://ckan.org/)-related content, please consider subscribing and letting us know your feedback. Additionally, if you want to learn more about enterprise-class project development, implementation, or support for [CKAN](https://ckan.org/), please do not hesitate to [contact us.](//linkdigital.com.au/get-in-touch/) We are happy to assist you and provide any information or resources needed to get started with [CKAN](https://ckan.org/). **Categories:** All articles, Amazon Web Services (AWS), CKAN, Open Data, Steven De Costa, Thought Leadership **Tags:** AWS, CKAN, ckan2.10, datapusher, open data, Thought Leadership --- ### [Data is living rent-free in your head](https://linkdigital.com.au/news/2023/05/data-is-living-rent-free-in-your-head/) **Published:** May 19, 2023 **Author:** Steven De Costa **Content:** May 17, Canberra – the [Australian Government Data Forum](https://www.act.ipaa.org.au/events/2023/australian-government-data-forum-2023) brought together approximately 300 participants, primarily from the Australian Public Service. The forum aimed to explore how data can inform the development of policies and programs that accurately reflect the current trends within the Australian community. As an attendee, I was encouraged by the presentations and the level of commitment shown by the Government. Overall it was a great event and I’m sure it will grow from strength to strength. However, as someone with an overly excited appreciation for what possibilities await us in the future, I just want to further evangelise just how important data is. So, please let me fail to adequately explain how data is living rent-free in your head and why the quality of such house guests matters to society. First, on being you, in three points: 1. Everything lives in your head, that is just the way it is. 2. What you observe has a fair chance of getting into your head, one way or another. 3. The quality of information shoved in your face matters, you become that quality. Now, it takes a village to raise a child, and ours is digital, global and connected. The village elders are our public institutions. We need their guidance and their actions to support civil society. The best liberal democratic way of doing this, I suggest, is via evidenced based policies, backed by publicly available and verifiable data. Let’s accept a genuine self-truth, we’re all kids when it comes to most of the big challenges our society faces. We can have a mature and informed understanding of some challenges, but not all the challenges. As such, we all need the support of our public institutions to raise us up to decent standards on key issues. Unfortunately, information pollution can make it near impossible for regular folk to inform themselves. It is even worse if we don’t have a clear and trusted voice coming from our public institutions. With questionable information being put in front of us, we risk becoming questionable actors in our own society. My appreciation of the Australian Government Data Forum, and my excitement about the future of data being leveraged for the public good more generally, exists because I know we have the will and the means to do both data and digital better. It was a great discussion on technology, governance, policy and capabilities surrounding data this week, and with consultation on the [Australian Government’s initial Data and Digital Government Strategy](https://www.dataanddigital.gov.au/) commencing soon, there is more to come. I encourage everyone to read the strategy and look for ways they can support our public institutions as they strengthen their data capabilities. With strengthened public institutions, data and digitally capable of meeting the needs of our communities, we will continue to raise up our children, ourselves and our society. Plus, in a healthy information space there will be less to fear about all those inevitable house guests knocking about in our heads. **Categories:** All articles, Open Data, Steven De Costa, Thought Leadership **Tags:** Thought Leadership --- ### [CKAN Achieves Digital Public Good Status](https://linkdigital.com.au/news/2023/08/ckan-achieves-digital-public-good-status/) **Published:** August 14, 2023 **Author:** Steven De Costa **Content:** The [CKAN](https://ckan.org/) platform has achieved a remarkable milestone, earning the status of a [Digital Public Good](https://digitalpublicgoods.net/). As announced on the [Open Knowledge Foundation’s blog on June 15, 2023](https://blog.okfn.org/2023/06/15/ckan-is-now-a-digital-public-good/), [CKAN](https://ckan.org/) has solidified its position as a crucial tool for sharing, accessing, and managing data in the digital age. This marks a significant step forward in the realm of open data and collaborative information sharing. [CKAN](https://ckan.org/), a powerful open-source data management system, has long been recognised for its ability to facilitate the distribution of data across various sectors. Now, its official designation as a Digital Public Good cements recognises [CKAN’s](https://ckan.org/) value not only as a technology but also as a driver of positive societal change. As a [Digital Public Good](http://digitalpublicgoods.net), [CKAN](https://ckan.org/) now holds the potential to empower governments, organisations, and individuals with the tools they need to unlock the value of data. This milestone enhances the platform’s credibility and encourages further adoption, potentially leading to increased innovation and the development of data-driven solutions to pressing global challenges. [CKAN’s](https://ckan.org/) new status as a [Digital Public Good](http://digitalpublicgoods.net) is a testament to the platform’s relevance and impact in the world of open data. As we move forward into an era where data is a precious resource, [CKAN ](https://ckan.org/)stands as a beacon of accessibility, cooperation, and progress, reaffirming its role as a pivotal player in the digital age. **Categories:** All articles, CKAN, Drupal, Government, Open Data, Steven De Costa, Technology Infrastructure, Thought Leadership **Tags:** CKAN, climate, digital public good, open data, Thought Leadership --- ### [Link Digital's Ongoing Partnership with GovHack and the Open Data Movement](https://linkdigital.com.au/news/2023/08/link-digitals-ongoing-partnership-with-govhack-and-the-open-data-movement/) **Published:** August 16, 2023 **Author:** Steven De Costa **Content:** Link Digital is proud this year to continue our support of the annual open government data competition [GovHack](https://govhack.org/), which will take place on August 18-20. A “hack” is the process of taking something and improving it or making it better. [GovHack](https://govhack.org/) is a two-day ‘hackathon’, from Friday night to Sunday evening, during which participants must create something clever or engaging using existing government data. Participants produce a pilot project that uses government data in some new or innovative way and an accompanying video that explains what they have done. First run by Australian National University in 2009, [GovHack](https://govhack.org/) now takes place in metropolitan and regional locations across Australia and New Zealand and attracts participants from around the world. One of the reasons Link Digital remains a keen supporter of [GovHack ](https://govhack.org/)is that its values align with those we seek to model in our everyday work for clients: bringing together a diverse range of stakeholders from the government, industry, not for profits and academia to showcase the practical economic and social benefits of open data. The event leverages off the creativity and experience of the community in such as a way as to highlight how government can be a subscriber and a contributor rather than the sole owner of the public data it collects, and through this enhance its services and mission. [GovHack](https://govhack.org/) also plays an invaluable role in exposing new people to data science, building their digital skills and increasing their awareness of the broader benefits of open data and particularly open government data, and its potential to solve the challenges we face. Since [GovHack](https://govhack.org/) started, over 2,500 projects have been published by participants to demonstrate the practical value of open data. Some of these have been picked up by government, including the government energy rating app and improvements to how Treasury can make budget data more easily accessible. Link Digital has been an active supporter of [GovHack](https://govhack.org/) for over a decade and this year we are proud local ACT sponsor of the event. **Categories:** All articles, CKAN, Government, Open Data, Steven De Costa, Thought Leadership **Tags:** govhack, Thought Leadership --- ### [Build your CKAN with Azure](https://linkdigital.com.au/building-your-ckan-with-azure-link-digital/) **Published:** February 7, 2022 **Author:** Hoa Nguyen **Content:** At Link Digital we work on a huge number of CKAN projects. CKAN is an open-source data management system (DMS) that is used to establish data hubs and data portals that make it easy for organisations to publish, share and work with data. With CKAN you can catalogue, store and access datasets via a rich front-end that is enabled with powerful platform features, visualisation tools and customisable plugins. You can also leverage its API to access the catalogue of datasets and data resources via a wide variety of other applications. ## **CKAN – The powerful data management platform** ![](https://linkdigital.com.au/wp-content/uploads/2022/02/Solr-and-ckan-1.png)My role is to help with the developer operations and infrastructure, and I’ve been working to expand our team’s capability to host and support CKAN on Microsoft Azure. To understand how CKAN’s components work together to make a powerful data platform, we need to identify those basic CKAN components and match them to relevant Azure services. CKAN components require a relational database system (PostgreSQL), search platform (Solr) and web platform (Python). With an understanding of each separate component within the system, we can decide the topology to match the size requirements of the service instances. ## **Deploying CKAN on Azure to meet business goals** ![](https://linkdigital.com.au/wp-content/uploads/2022/02/blog3-1.png)The first option, which is suitable for some of our clients, is to place all components inside a single virtual machine (VM). Placing all components inside an instance could be a good choice for a small client wanting to build a small hub or portal. Thus, we can make an easy setup with the database platform, search platform and web platform (with CKAN’s Python codebase) in a single VM. The main limit to such a topology, which many clients will experience, is its poor handling of large volumes of traffic generated from end-users. The single VM topology will take a lot of effort to maintain, upgrade and scale up. The second option is to build and deploy service instances separately, to provide some convenience for the system admins during maintenance. Furthermore, service instances can be built as a cluster that can provide high IO and HA. While making a service instance as a dependent node, a Web instance (Python) could be scheduled to scale out to multiple nodes during high peak hours or a small number of nodes on non-high peak hours. The deployment in this case will aid large systems that handle much more traffic over the internet. The drawback, of course, is the cost of making multiple nodes for both Web & Service instances. Wait a minute, do we have a hybrid option that combines both? Well, I would say “no” but yes. While many clients should want to share the Service instance to reduce the cost for maintenance but still get a good IO for their service. With these options, we provide such software as a service that contains database services and search services. Then clients can pay for their web instance, and pay an extra fee for our hosting services. They could consider this topology with the first one, and with an additional payment, clients can get a better IO from the database & search service. Because their hosts only handle web instances that can be extended easily. ## **AWS & Azure cost comparison** Based on[ CKAN requirements](https://github.com/ckan/ckan/wiki/CKAN-hosting-guidelines), CKAN should be deployed in 2 nodes. Before making a comparison, we would need to understand the size of the system and what CKAN requires for the resource. Get in touch with us [here](https://linkdigital.com.au/get-in-touch/) for more information about pricing your project. ## **Building your CKAN in the real world** ![](https://linkdigital.com.au/wp-content/uploads/2022/02/blog5-1024x570.png) **Categories:** All articles, CKAN, Government, Higher Education/Research, Microsoft Azure, Open Data, Resources --- ### [Improving build times with CKAN and Docker](https://linkdigital.com.au/news/2021/03/improving-build-times-with-ckan-and-docker/) **Published:** March 12, 2021 **Author:** Brett Jones **Content:** I’ve been working with [Link Digital ](http://linkdigital.com.au)from the Berlin office over the last 18 months, mostly within the CKAN Tech Team to assist the regular operations of supporting, improving, and shipping CKAN for it’s community of users. My time has been spent helping out with CKAN issues and PR’s mainly in the DevOps area, Docker installs, packaging CKAN releases, testing PR’s and new releases, plus documentation. However, I have recently been investigating some platform tools for Link Digital. As part of this, I have the following to share, which I think might benefit the community of CKAN folks also working on platform build techniques and methods. **Background** The CKAN software stack can be installed as Docker containers. This is useful when you are enhancing CKAN code as you can be assured the CKAN stack you are building will work in the same way no matter what environment (OS, VM or physical server) hosts the CKAN stack, as long as the Docker Engine is running. It’s a way of *controlling* how your CKAN software additions/enhancements will operate in **all** environments (Dev, Test and Production). This can dramatically reduce the changes needed for each environment if you were rolling out CKAN enhancements to a more traditional setup. **Aim** - To run the CKAN stack as Docker containers using Docker Compose - To analyse where efficiencies can be made to reduce the time to build the CKAN containers - To implement those efficiencies and record the time it takes to build and run the CKAN stack - Once implemented it will be straight-forward to move to an orchestrated container environment using either - Docker Swarm - Kubernetes - [amazee.io](http://amazee.io/)’s Docker-based Lagoon environment **CKAN software stack** The CKAN software stack contains - CKAN Web (v2.9.2 – to run the web UI) - CKAN Workers (v2.9.2 to run jobs and harvest workers) - PostgreSQL (for CKAN and Datastore) - Solr - Redis **The initial build** - Both CKAN images use ubuntu:20:10 as the base image - System packages are then installed - Python virtual environment installed - pip, setuptools installed - CKAN and CKAN extension software installed - config management software installed - PostgreSQL uses million/postgis:11 as the base image - Solr uses solr:6.6.6 as the base image - Redis uses amazeeio/redis:6-latest as the base image Time to build: **19 mins, 24 secs** (most of this was building both CKAN containers) **After efficiencies made** The obvious area to explore reducing *time-to-build* is both CKAN container builds (ckan-web and ckan-workers) as there is a large double-up of steps. A new CKAN base image is now pre-built which is based on the uselagoon/python-3.8 image and can be downloaded from DockerHub. The uselagoon/\* images use Alpine as the base image which is a robust, security-oriented, lightweight Linux distribution. The new CKAN base image includes: - system packages, - a Python virtual environment, - installs of pip3 and setuptools - installation of CKAN - Supervisor installation The 2 CKAN images (ckan-web and ckan-worker) are now derived from this new CKAN base image and they include: - certain CKAN extensions (xloader, harvest, syndicate and scheming) - config management (using crudini) - setup files - file/directory creating and permission changes - health checks (CKAN web) The new PostgreSQL, Solr and Redis builds are based on based on uselagoon/\* images so are very lean and add to the overall efficiencies made. A new NGINX container was also added to the CKAN stack and the base image for this was uselagoon/nginx Time to build: **4 mins, 51 secs** ie: more than **4x** faster) The repository for the CKAN stack after the efficiencies were made is located at: I wasn’t expecting the build time to reduce so drastically with these changes. However, by using a pre-built Docker image for the base CKAN configuration tasks we can re-use a large portion of the build steps for multiple containers, greatly simplifying the build process. At Link Digital we provide fully managed open data platforms based on CKAN. If you need support for your own data portal please feel free to [get in touch](https://linkdigital.com.au/get-in-touch/) and we can find a way to help out. ![](https://linkdigital.com.au/wp-content/uploads/2021/03/CKAN-and-Docker-1024x853.png) **Categories:** CKAN, Resources **Tags:** docker, lagoon, open data --- ### [Reimagining open data portals: debates and research paths](https://linkdigital.com.au/news/2024/02/reimagining-open-data-portals-debates-and-research-paths/) **Published:** February 15, 2024 **Author:** Andrew Nette **Content:** While making data ‘open’ for the common good arguably dates back as far back as the earliest shipping logs and trade registries, ‘open data science’ only began to take shape in the late 1950s. According to [a 2023 article](https://apolitical.co/solution-articles/en/open-data-101-the-history-and-principles-of-open-data-part-1) by Paul Connor, Executive Director of the [Canadian Open Data Society](https://www.opendatasociety.ca/), ‘open data’ first emerged as an agreed descriptor in 1995. Now a frequently used term, its most common manifestation is the open data portal, the first of which appeared in 2009 – [data.gov](https://data.gov/), the United States’ vast online repository of open data, and [datos.gob.es](https://datos.gob.es/en), the Spanish Government’s open data portal. And there are now, literally, thousands of open data platforms around the world. But although they may be ubiquitous, have open data portals met the promise that often accompanied their release and what is their future? These questions were discussed in a panel at the [State of Open Data Con](https://stateofopencon.com/) in London in early February, titled ‘Reimagining open data portals: towards a collaborative research agenda.’ The panel featured [Elena Simperl](https://www.kcl.ac.uk/people/elena-simperl), Professor of Computer Science at Kings College London and Director of Research at [Open Data Institute](https://theodi.org/), [Doctor Jonathan Gray](https://www.kcl.ac.uk/people/dr-jonathan-gray), Director of the Centre for Digital Culture at Kings College London and co-founder of [Public Data Lab](https://publicdatalab.org/), and [Link Digital’s](https://linkdigital.com.au/) recently appointed Chief Technology Officer and Head of Europe, [Paul Walsh](https://www.linkedin.com/in/prwalsh/?originalSubdomain=il). Gray’s contribution amplified on his research published [in a March 2023 article in the journal *Data and Policy*](https://www.cambridge.org/core/journals/data-and-policy/article/what-do-data-portals-do-tracing-the-politics-of-online-devices-for-making-data-public/4C71EA4503A83EFA27EA7F7F67FE206F). This analysed the evolution of open data portals, the veracity of claims made around their contribution to ‘innovation, public empowerment and government transparency,’ and some of the critiques of them that have surfaced. For example, among the criticisms specifically levelled at the United Kingdom’s [data.gov.uk](https://www.data.gov.uk/), are that its ‘datasets were “old,” “irrelevant” and infrequently updated, that important datasets were missing (e.g., election results), and the portal does not make data accessible for broader publics.’ “We are seeing a renewed interest in data portals, or data cataloguing systems more generally,” Walsh said in comments made after the panel. “I think that is tied to a general problem of ‘knowledge management’, rather than in the early stages where open data release was closely tied to transparency initiatives in government. However, governments still need to address fundamental issues around data: how it is shared, internally and externally, catalogued, and how data is made discoverable for a range of human and non-human actors.” Gray’s article cites [a 2022 literature review on data portals](https://dataportals.pubpub.org/pub/qk1untv2/release/2) that posits an ‘expectations gap’ between the different aims of portals and their ‘limitations, faults and unfulfilled promise,’ including shortcomings related to transparency and broader accessibility. “I think we can look at this from two perspectives, consumers of data and publishers of data,” Walsh maintained. “In my reading, the sector in general, and research in particular, is focussed on the consumer, the generic constituent or business that can leverage open data that a government publishes. This often leads to an assessment of the ways in which open data portals don’t deliver on their promise, due to lack of data reuse and so on.” “Going forward, we obviously need to create better user experiences for this audience, but we also focus more on programmatic access to data and metadata, and related functionality like access and sharing mechanisms, and data lineage information. As for publishers, there are huge amounts of friction in organisations like governments to publicly releasing data in the first place. Even just having an open data portal and a policy around it starts to create internal capability and processes to support this data release, and that in general is an outcome that is too often overlooked in analysis of data portals.” These thoughts were echoed by Simperl in her contribution to the [State of Open Data Con](https://stateofopencon.com/) panel. She argued that while open data portals remain a key form of open data infrastructure, they need to become more multifaceted and focus on enhanced data transferability and usability features. She mentioned several specific features that portals will need to align with in the future to be considered best practice in open data. These include: data sets that are accompanied by a comprehensive descriptive record going beyond a collection of basic metadata; providing supporting documentation that can be immediately accessed from within the dataset and is context sensitive so that users can immediately access information about a specific item of concern; allowing an extract of the data to be previewed for sense making; and ensuring that portals make recommendations for related data sets and allows users to review/rate the datasets. Simprel’s focus on best practice in regard to discoverability, improved standards to maximise interoperability, and the provision of quality metadata to enhance comprehension and re-use are very much in line with the ‘[Third Wave of Open Data’](https://opendatapolicylab.org/third-wave-of-open-data/), and its proposition that the open data ecosystem has moved beyond a focus on simplifying and disseminating data to how data can better be systematised and how governments, private corporations and civil society organisations can better know and understand the data they have and share it to provide improved products and services, and a more informed citizenry. As the [*Third Wave of Open Data Tool Kit*](https://files.thegovlab.org/The-Third-Wave-of-Open-Data-Toolkit.pdf) puts it: ‘While the open data portal format will likely remain a common piece of technical infrastructure, new and sophisticated technological developments could facilitate greater collaboration and responsibility in data re-use.’ Put more simply, there is a need to move beyond the tick box approach to making data open that characterises some open data portals and ensure portals become more interactive, including enabling users to contribute data, collaborate on open data projects, and engage in real-time discussion about data. In the Australian context, this relates [to comments Link Digital made](https://linkdigital.com.au/news/2024/01/new-reports-outline-australian-governments-directions-in-data-and-digital-space/) in relation to the [Metrics Framework](https://www.dataanddigital.gov.au/sites/default/files/2023-12/Data%20and%20Digital%20Metrics%20Framework%20v1.0.pdf) that accompanied the [Australian Government’s recently released *Data and Digital Government Strategy*](https://www.dataanddigital.gov.au/plan). One of the metrics was ‘# of data assets discoverable and available for use’. While this was certainly an early metric adopted by the open data movement, it is highly malleable and ignores important issues such as data quality and relevance. The mere existence of an open data portal is not enough. We also need to ask questions such as, is it up to date, is the data high quality, and is the portal embedded in a deliberate strategy to engage, empower, and inform. The [State of Open Data Con](https://stateofopencon.com/) panel also discussed future research to inform how open data portals might be designed and developed differently. “The main takeaway was a desire to do further research on how data portals are used and how that has changed over time,” Walsh said. He added that the [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN), a piece of open-source software launched in 2006 that can be configured and set up to function as an open data platform once it is deployed and hosted on a web server, will remain of central relevance. “I strongly believe [open source matters for government](https://rufuspollock.com/open-source-software-and-government/). CKAN is by far the most widely adopted open source solution for data portals and for data cataloguing generally. CKAN and the community around it are uniquely positioned to be a driving change in better user experience for data consumers and publishers, and in developing novel approaches to data.” Data collections such as [Link Digital’s](https://linkdigital.com.au/) [Datashades.info](https://datashades.info/) and [DataPortals.org](https://dataportals.org/), run by the [Open Knowledge Foundation](https://okfn.org/) (OKF) will be of vital importance in this research. The OKF’s [DataPortals.org](https://dataportals.org/) lists 598 open data portals based on CKAN, and research carried out by the [Pathways to Enable Open-Source Ecosystems ](https://civicdataecosystem.org/)project into CKAN, identified nearly 400 regularly updated CKAN data portals in 59 countries, ranging large to small portals. “Platforms like CKAN provide a technical foundation for addressing these issues, and this includes, but is well beyond, ‘the open data portal’ use case. There is so much more that can be done in terms of technical platforms like CKAN and capacity building, data literacy initiatives, to streamline data publication.” Topics like the one in this post are discussed in a series of forums by [Link Digital](https://linkdigital.com.au/) on the last Thursday of every month, Australian EDT. These forums will connect you with like-minded experts who are passionate about the importance of open data and want to stay updated on the latest developments in the field. They are free to attend and open to everyone. [Register today](https://linkdigital.com.au/public-forum/?utm_source=google&utm_medium=blog). **Categories:** All articles, Environmental/Climate Change, Open Data, Technology Infrastructure --- ### [Further growth planned for Link Digital: Paul Walsh to Join the team as Chief Technology Officer and Head of Europe](https://linkdigital.com.au/news/2023/11/further-growth-planned-for-link-digital-paul-walsh-to-join-the-team-as-chief-technology-officer-and-head-of-europe/) **Published:** November 21, 2023 **Author:** Andrew Nette **Content:** After a busy year, [Link Digital](https://linkdigital.com.au/) is finishing 2023 on a particularly high note, with the announcement that data management and open knowledge leader Paul Walsh will join our team in mid-January 2024, as Chief Technology Officer (CTO) and Head of Europe. Walsh brings extensive experience and knowledge in open data technology, having previously been Chief Executive Officer of [Datopian](https://www.datopian.com/), and CTO of the not for profit [Open Knowledge Foundation](https://okfn.org/en/). His expertise in and passion for open data and technology strategy makes him an ideal fit for [Link Digital](https://linkdigital.com.au/). Walsh’s arrival will strengthen our technological and client facing capabilities, our interaction with the open data ecosystem, and reinforce our ongoing commitment to the [Comprehensive Knowledge Archive Network](https://ckan.org/), of which we are a co-steward. [Link Digital](https://linkdigital.com.au/) is a trusted global digital service company that uses open source technology to unlock the power of data and solve real world problems. We are in Australia, the Philippines, Vietnam, and Ukraine, and recently incorporated a subsidiary entity in Canada, Datashades Inc trading as Link Digital Canada. Indeed, this week our Chairman Steven De Costa will deliver the keynote at the [Canadian Open Data Summit](https://www.opendatasummit.ca/) on the theme of ‘The Architecture of Trust: Open and Honest Data’. De Costa will also be holding an Executive Briefing that will make the case for a Policy-to-Practice Accelerator Program tailored for government teams. For some time now we have been keen to expand our influence and commitment to leading-edge solutions in data management to Europe and are looking forward to leveraging Walsh’s considerable experience to that end. We will share more details as we approach Walsh’s official start date. His appointment, along with developments such as our Policy-to-Practice Accelerator Program, all promise to make 2024 an exciting year in [Link Digital’s](https://linkdigital.com.au/) development. **Categories:** All articles **Tags:** Company Announcement, Link Digital CTO --- ### [Using Open Data to Sustainably Manage Water Resources](https://linkdigital.com.au/news/2023/10/using-open-data-to-sustainably-manage-water-resources/) **Published:** October 18, 2023 **Author:** Andrew Nette **Content:** October 16th to 22nd is [National Water Week](https://www.nationalwaterweek.org/). Hosted by the [Australian Water Association](https://www.awa.asn.au/), a not-for-profit network seeking a more sustainable water future, the theme of [National Water Week](https://www.awa.asn.au/) 2023 is ‘United by Water’. The Week aims to remind Australians of the need to use water wisely and to celebrate achievements in water innovation. Both are crucial as climate change means Australia needs to prepare for a hotter, drier future. As a global data company specialising in open-source solutions to help solve real-world problems, [Link Digital](https://linkdigital.com.au/) believes that data can play a crucial part in helping to manage water resources more sustainably. This is part of a much larger role for open data/open source projects in helping governments, researchers and citizen’s groups gain a deeper understanding of the changes taking place to the earth’s environment, including the climate. This knowledge can then be used to assist these groups to make more data-driven and informed decisions about the sustainable management of resources and adapting to and mitigating climate change. Link Digital has been involved in several important water-related open data projects. In Canada, where the company recently set up an incorporated subsidiary entity, [Datashades Inc](https://datashades.info/). trading as Link Digital Canada, this has included work with the [Canadian Watershed Information Network](https://canwin-datahub.ad.umanitoba.ca/) (CanWin) to overhaul its [CanWIN Data Hub](https://canwin-datahub.ad.umanitoba.ca/). More recent projects are a newly completed upgrade of [Living Lakes Canada](https://livinglakescanada.ca/)’s [Columbia Basin Water Hub](https://data.cbwaterhub.ca/), and a soon-to-be finalised open data portal for the [Nicola Watershed Governance Partnership](https://nwgp.ca/), a governance agreement involving the province of British Columbia and the area’s First Nation’s people. In Australia, [Link Digital](https://linkdigital.com.au/) recently completed a redesign of the [New South Wales Department of Planning, Industry and Environment](https://www.dpie.nsw.gov.au/)’s [SEED (Sharing and Enabling Environmental Data) Portal](https://www.seed.nsw.gov.au/) that brings together state-wide environment data on issues relating to land, water, plants, animals and air. This included giving it a fresh look, greater functionality and improved accessibility to ensure all users can freely browse the data they need. All these portals use the [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN), a piece of open-source software launched in 2006 that can be configured and set up to function as an open data platform once it is deployed and hosted on a web server. In addition to a growing installation base, CKAN boasts a community of users and contributors, which gives it wide potential for adoption and significant capabilities. The [CanWIN Data Hub](https://canwin-datahub.ad.umanitoba.ca/) is a particularly powerful example of open data in the service of helping to solve real-world problems. The Hub is part of [Canada’s Spatial Data Infrastructure](https://natural-resources.canada.ca/science-and-data/science-and-research/geomatics/canadas-spatial-data-infrastructure/10783) system, the relevant base collection of standards, policies, applications, and governance that facilitate the access, use, integration, and preservation of spatial data. It is hosted at the [University of Manitoba](https://umanitoba.ca/), and managed by its [Centre for Earth Observation Science](https://umanitoba.ca/earth-observation-science/) (CEOS). While CEOS researchers conduct fieldwork globally, a particular focus is the Arctic-freshwater marine system because climate change affects this region more acutely than anywhere else in the world. Examining this area on an ecosystem scale requires access to large amounts of complex data across disciplinary, cultural and political boundaries, and hence a research data infrastructure that can accelerate the sharing, discovery, visualisation and analysis of diverse data, including sensitive indigenous knowledge. The original [CanWIN Data Hub](https://canwin-datahub.ad.umanitoba.ca/) was developed by the Canadian Government to share freshwater research in Lake Winnipeg Basin, an approximately 25,000-square kilometre lake in Canada’s Manitoba province, but was not able to capture the complexity of the multi-disciplinary data produced by the portal. Working with various stakeholders, [Link Digital](https://linkdigital.com.au/) redesigned the portal to enable it to show the complex relationships between the various data collected and to allow for greater interoperability. The project also required that the data be built into the existing secure hosting infrastructure to safeguard against corruption and loss. The Hub is part of a pan-Canadian collaboration between six universities and multiple Indigenous, government and not-for-profit organisations, in turn part of a larger project known as [Canadian Consortium for Arctic Data Interoperability](https://ccadi.ca/). This will allow for the data generated by [CanWIN Data Hub](https://canwin-datahub.ad.umanitoba.ca/) to be used to examine the impacts of climate change not only at a local and national scale but also regionally and internationally. Topics like the one in this post will be discussed in a new series of forums being held by Link Digital on the last Thursday of every month, Australian EDT. These forums will connect you with like-minded experts who are passionate about the importance of open data and want to stay updated on the latest developments in the field. They are free to attend and open to everyone. [Register today](https://linkdigital.com.au/link-digital-public-forum/). **Categories:** All articles, CKAN, Drupal, Environmental/Climate Change, Open Data **Tags:** open data, sustainability, water week --- ### [An Exciting CKAN Collaboration with data.world](https://linkdigital.com.au/news/2017/07/an-exciting-collaboration-with-data-world/) **Published:** July 17, 2017 **Author:** Steven De Costa **Content:** A few months ago, we teamed up with data.world to co-develop an extension that would facilitate open data sharing for CKAN users around the world. As a CKAN Association member, Link Digital is heavily involved in activities surrounding CKAN. An opportunity to collaborate with data.world, the creator of a popular networking platform for people working with data, was not only an exciting experience but also a great chance to make a contribution to the open source community. ## About ckanext-datadotworld The extension allows ckan data portal administrators to automatically replicate the published data to a data.world profile. By linking your data to data.world, you accelerate its discovery, thereby facilitate the resolution of important issues. For its extensive and customizable API, CKAN is easy to integrate even with a custom platform, such as data.world. The ckanext-datadotworld extension is completely open-source and is available for download on GitHub today. If you would like to trial the extension on Datashades.com please contact us on support@linkdigital.com.au. ### Watch the video guide on LinkDigitalTV ## About data.world Data.world is a US-based company that strives to build the most meaningful, collaborative, and abundant data resource in the world. Launched in July 2016, the company has built a network that makes it easier for people who work with data to collaborate and solve important problems. For more information, visit data.world. More information about ckanext-datadotworld can be found on the [CKAN blog](https://ckan.org/2017/06/06/announcing-the-data-world-extension-public-release-for-ckan/). **To download the extension:** **To view other Datashades extensions:** **Related news:** [Link Digital’s Lead Developer Officially Joins CKAN Technical Team](https://linkdigital.com.au/news/2017/05/link-digital%E2%80%99s-lead-developer-officially-joins-ckan-technical-team) **Categories:** CKAN, Open Data --- ### [Introducing the Pacific Data Hub](https://linkdigital.com.au/news/2019/04/south-pacific-data-hub/) **Published:** April 10, 2019 **Author:** Steven De Costa **Content:** The [Pacific Community](https://www.spc.int/) (SPC) teamed up with Link Digital to build their [Pacific Data Hub](https://pacificdata.org) on a modern platform to help streamline their data delivery to the public. As the principle scientific and technical organisation in the pacific, the Pacific Community is the custodian of the largest and most diverse collection of data on the Pacific Island region cutting across all its key sectors, including population statistics, fisheries, geoscience, agriculture, aquaculture, energy, education, human rights, climate change and oceans. In addition, SPC has been charged with a critical role in the compilation, updating and dissemination of the Pacific Sustainable Development indicator to assist countries in meeting the Sustainable Development Goals reporting requirements. Creating a single Pacific Data Hub was identified as a critical opportunity by the SPC that would enable them to become a single, authoritative point of entry for all Pacific data; and the SPC chose Link Digital to provide the implementation and hosting that helped turn that opportunity into a reality. The Pacific Data Hub is developed as a CKAN+Drupal installation, that seamlessly combines both platforms into a best-of-both-worlds content management system (CMS) plus open data platform solution. Hosting is also managed by Link Digital on an AWS infrastructure optimised for CKAN+Drupal deployments. This foundation supports UI and data visualisations completely customised by Link Digital according to the exact specifications of SPC to provide an open data portal that is both beautiful and highly functional to the public. ## Key Deliverables: - Project consultation and scoping via project sprint - UI/UX design work, including Information architecture and wireframe development - Consultation and development around technical infrastructure and various data-related issues - Development and deployment of customised Drupal+CKAN open data portal - Highly detailed and customised showcase data visualisations, implemented via D3, that are seamlessly integrated into the wider site - Fully responsive design for desktop, mobile and tablet devices The Pacific Data Hub can be found at ## Increasing the value of Pacific Community Data CKAN increases the value of dataset collections via: - Metadata and data resource management over API and UI - Organisation specific contexts for search, discovery and access of data - Integrated data visualisation and dashboard management - 200+ extensions supporting many more features If you would like to know more about how CKAN can increase the value of data for your organisation please [get in touch](https://linkdigital.com.au/get-in-touch/). **Categories:** Open Data --- ### [CKAN 2.9 now available on the AWS Marketplace](https://linkdigital.com.au/news/2020/12/ckan-29-now-available-on-the-aws-marketplace/) **Published:** December 22, 2020 **Author:** Joel Wigley **Content:** Link Digital are pleased to announce the general availability of CKAN 2.9 as a free Amazon Machine Image (AMI) on the [AWS Marketplace](https://aws.amazon.com/marketplace/seller-profile?id=c7ed1d85-7fb8-4a85-9d27-a4de8745a9ef&ref=dtl_B08Q869FTH). Link Digital are co-stewards of the CKAN project and have provided free, open source CKAN images through the AWS Marketplace since early 2014. During that time hundreds of installations have been implemented world-wide, with over half of those occurring within the last two years. The availability of CKAN 2.9 marks a major milestone in development, being the first version to support Python 3, since Python 2 reached it’s end-of-life in January. **Some of the new features this release of CKAN 2.9 are:** - Python 3.6, 3.7 and 3.8 support. - Improved API security via it’s [token system](https://docs.ckan.org/en/2.9/api/index.html#api-authentication). - A new [*package\_revise*](https://docs.ckan.org/en/2.9/api/index.html#ckan.logic.action.update.package_revise) API call allowing concurrent uploads / changes. - Finer grained control of dataset permissions via [Collaborators](https://docs.ckan.org/en/2.9/maintaining/authorization.html#dataset-collaborators). *You can view the full changelog for CKAN 2.9 and 2.9.1* [*here*](https://docs.ckan.org/en/2.9/changelog.html#v-2-9-1-2020-10-21)*.* Most CKAN extensions have already been updated to support Python 3 and thus CKAN 2.9. The following extensions come pre-packaged with our Marketplace image: - [Datastore](http://docs.ckan.org/en/latest/maintaining/datastore.html) – storage for structured data (think CSV) imported into CKAN. - [XLoader](https://github.com/ckan/ckanext-xloader/) – used to load data into the Datastore. Previous versions used the [Datapusher](https://github.com/ckan/datapusher) extension however XLoader has become the faster, more reliable option for this task. - [Geo View](https://github.com/DataShades/ckanext-geoview) – provides plugins for Geospatial data views. - [Pages](https://github.com/DataShades/ckanext-pages) – allows you to create simple HTML pages within CKAN without the need for a third-party CMS. - [Harvester](https://github.com/DataShades/ckanext-harvest) – allows datasets to be “harvested” or copied from remote CKAN portals on a schedule. There are many more extensions that can be added to your CKAN portal with minimal effort. A good list and starting point is our [Datashades](https://github.com/datashades?q=ckanext) organisation on GitHub where you will find such highlights as: - [SAML2](https://github.com/DataShades/ckanext-saml2) – enables Single Sign On (SSO) for your CKAN portal using SAML2 authentication. - [CloudStorage](https://github.com/DataShades/ckanext-cloudstorage) – provides the ability to use cloud storage like S3 or Azure to store your CKAN resources. - [Syndicate](https://github.com/DataShades/ckanext-syndicate) – lets you syndicate your local datasets to remote CKAN portals. - [Google Analytics](https://github.com/DataShades/ckanext-googleanalytics) – easily adds Google Analytics tracking codes to all parts of your CKAN portal. When adding these or other extensions to your CKAN 2.9 portal, ensure you’re cloning the *py3* branch for Python 3 support and follow the README instructions to install. All in all, CKAN 2.9 is a big step forward for CKAN and the open data community as a whole. With Python 3 support nailed down, developers will be able to focus their efforts on new features and improvements that will benefit all users. Link Digital is established globally as a leading developer and provider of support for CKAN based Open Data portals. For more information about enterprise class project development, implementation or support please contact us [here](https://linkdigital.com.au/get-in-touch/?gclid=CjwKCAiAoOz-BRBdEiwAyuvA62ZSLAx6ks1d9JiWSOXqE63wgBKZVP1CXjPyU9ZfqsVnWUJlXgIkNhoC8ucQAvD_BwE). [![AWS AMI Release for CKAN delivered by Link Digital](https://linkdigital.com.au/wp-content/uploads/2020/12/AWS-AMI-Release-CKAN-1024x535.png)](https://aws.amazon.com/marketplace/seller-profile?id=c7ed1d85-7fb8-4a85-9d27-a4de8745a9ef&ref=dtl_B08Q869FTH) **Categories:** CKAN, Open Data **Tags:** AWS, CKAN, open data --- ## Pages ### [CKAN Experts and Open Data Portal Services​ | Link Digital](https://linkdigital.com.au/) **Published:** May 24, 2017 **Author:** Steven De Costa **Excerpt:** Official CKAN co-steward. We build, host, and support open data portals for governments, academic and research institutions worldwide. Talk to our team today. **Content:** # CKAN Experts and Open Data Portal Services We build, host, and support open data portals for governments, academic and research institutions worldwide. [ Browse case studies ](https://linkdigital.com.au/case-studies) [ CKAN services ](https://linkdigital.com.au/services/end-to-end-ckan/) [ Discover Ask AI ](https://linkdigital.com.au/ask-ai/) ## Trusted by government agencies, international organisations, and research institutions across Australia, Canada, the Pacific, and Latin America. ## What we do ### Ask AI for CKAN Transform your data portal into an insight engine. For 25 years, Link Digital has built the digital infrastructure that governments and global institutions rely on. As major CKAN developers and co-stewards, we know the way people access data is changing, and so must the experience of working with open data. Ask AI is our answer: a grounded and secure way to let your users ask questions and get verified answers from your own data. [ Schedule a discovery call ](https://linkdigital.com.au/ask-ai/) ![CKAN Chart](https://linkdigital.com.au/wp-content/uploads/2024/07/main-image-move-CKAN-768x288.png) ### [### Making data accessible](https://linkdigital.com.au/ckan/) Link Digital is the trusted CKAN expert globally. Our CKAN and open data experts provide managed CKAN hosting, support, extension development, and theming to clients. We are co-stewards of the CKAN Project. [ Read more › ](https://linkdigital.com.au/ckan/) ![AWS](https://linkdigital.com.au/wp-content/uploads/2024/10/aws-section.webp) ### [### Hosting data ecosystems](https://linkdigital.com.au/aws/) We provide managed hosting, support and cloud architecture services to non-profit, government, research and academic institutions. [ Discover more › ](https://linkdigital.com.au/aws/) ![Drupal](https://linkdigital.com.au/wp-content/uploads/2024/10/drupal-right.webp) ### [### Engaging data portal](https://linkdigital.com.au/drupal/) We develop digital experiences, services and dashboards with a strong emphasis on supporting content authors and end users. Since 2012, we have leveraged our years of experience in Drupal-based projects. [ Explore more › ](https://linkdigital.com.au/drupal/) ## What others say about Link Digital "As the programme lead for SPC's Pacific Data Hub, I have witnessed firsthand the transformative impact of our collaboration with Link Digital. Their deep expertise in CKAN and Drupal, coupled with an intrinsic understanding of our goals and values, has been instrumental in our data journey. Steven de Costa and his team have not only provided exceptional technology solutions but have also fostered a relationship rooted in trust, respect, and shared advocacy for data-driven sustainable development in the Pacific." ![Publish your data easily](https://linkdigital.com.au/wp-content/uploads/2025/01/CKAN-and-the-private-sector-e1737523886505.webp) Sioeli Tonga Program Manager, Pacific Community’s Pacific Data Hub [ Case study: Pacific Data Hub ](https://linkdigital.com.au/case-studies/pacific-data-hub/) "As Living Lakes Canada extends our reach to empower communities in water advocacy through open data access, Link Digital’s expertise ensures successful portal design and implementation. Together, we strive for impactful results." ![Publish your data easily](https://linkdigital.com.au/wp-content/uploads/2025/01/CKAN-and-the-private-sector-e1737523886505.webp) Maggie Finkle-Aucoin GIS and Database Manager for Living Lakes Canada [ Case study: Columbia Basin Water Hub ](https://linkdigital.com.au/case-studies/columbia-basin-water-hub/) "CKAN customised schemas have allowed us to be searchable by Google data set searches and other global partners, which is key to the findability of our data sets. Flexibility with user permissions and our customised templates allow us to provide data sovereignty to our users and give them granular control over their data." ![Publish your data easily](https://linkdigital.com.au/wp-content/uploads/2025/01/CKAN-and-the-private-sector-e1737523886505.webp) Claire Herbert Head, Digital Strategy, Centre for Earth Observation Science, Faculty of Environment, Earth and Resources, University of Manitoba [ Case study: Canadian Watershed Information Network (CanWIN) ](https://linkdigital.com.au/project/canadian-watershed-information-network-canwin/) "When we started looking for data portals, we wanted something that did most of what we wanted out of the box, and which didn’t lock us to a specific provider. CKAN was pretty much the only one we found." ![Publish your data easily](https://linkdigital.com.au/wp-content/uploads/2025/01/CKAN-and-the-private-sector-e1737523886505.webp) Hilde Austlid Senior Engineer for Norwegian Public Roads Administration National Data Portal [ Case study: Norwegian Public Roads Administration Data Portal ](https://linkdigital.com.au/case-studies/canadian-watershed-information-network-canwin/) ## Who we work with ![University of Manitoba](https://linkdigital.com.au/wp-content/uploads/2024/04/01_UM-1.webp) ![Australia Government](https://linkdigital.com.au/wp-content/uploads/2024/04/02_AU-Gov.webp) ![Pacific Community](https://linkdigital.com.au/wp-content/uploads/2024/04/03_Pacific-Community.webp) ![data.gov.au](https://linkdigital.com.au/wp-content/uploads/2024/04/05_data.gov_.au_.webp) ![Living Lakes Canada](https://linkdigital.com.au/wp-content/uploads/2024/04/06_Living-Lakes-Canada.webp) ![NSW Government](https://linkdigital.com.au/wp-content/uploads/2024/04/04_NSW-Government.webp) ![SES NSW State Emergency Service](https://linkdigital.com.au/wp-content/uploads/2024/04/07_NSW-SES.webp) ![Government of South Australia](https://linkdigital.com.au/wp-content/uploads/2024/04/09_Gov-South-Aus.webp) ![Government of Western Australia](https://linkdigital.com.au/wp-content/uploads/2024/04/10_Gov-WA.webp) ![ACT Government](https://linkdigital.com.au/wp-content/uploads/2024/04/11_ACT-Gov.webp) If you have a project to discuss with us or would like to know more about our services, we’d love to hear from you. [ Book a consultation ](https://linkdigital.com.au/get-in-touch/) --- ### [Case studies](https://linkdigital.com.au/case-studies/) **Published:** May 23, 2017 **Author:** Steven De Costa **Content:** Filters - Technology Infrastructure + - Drupal + - CKAN + - Azure + - AWS + - Region + - South America + - Europe + - Canada + - Australia and New Zealand + - Asia and the Pacific + - Industry + - Non-profit/NGO + - Multilateral organisations + - Higher Education/Research + - Government/Public Sector + - Environmental/Climate Change + - Capabilities + - Product Development + - Open data portal + - Managed Hosting + - Internal data hub + - End to end CKAN Services + - CKAN Migration + - Application Development + - All case studies + Reset [![A national OECD government open data portal homepage](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/case-studies/upgrading-a-national-oecd-government-open-data-portal-to-a-full-ckan-environment/) ### [Upgrading a national OECD government open data portal to a full CKAN environment](https://linkdigital.com.au/case-studies/upgrading-a-national-oecd-government-open-data-portal-to-a-full-ckan-environment/) At a glance A major upgrade of a national OECD government data portal, including a complex migration process from a mixed software configuration to a... [Read case study ❯](https://linkdigital.com.au/case-studies/upgrading-a-national-oecd-government-open-data-portal-to-a-full-ckan-environment/) [![Case study of Climate Data Portal based on CKAN for the New South Wales Government by Link Digital](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/case-studies/ckan-powered-data-portal-delivers-secure-efficient-climate-projections-for-nsw-government/) ### [CKAN-powered data portal delivers secure, efficient climate projections for NSW Government](https://linkdigital.com.au/case-studies/ckan-powered-data-portal-delivers-secure-efficient-climate-projections-for-nsw-government/) Helping the New South Wales Government share large-scale climate data efficiently and securely Client New South Wales Department of Climate Change, Energy, the Environment and... [Read case study ❯](https://linkdigital.com.au/case-studies/ckan-powered-data-portal-delivers-secure-efficient-climate-projections-for-nsw-government/) [![Norwegian Public Roads Administration Data Portal](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/case-studies/norwegian-public-roads-administration-data-portal/) ### [CKAN implementation for Norwegian Public Roads Administration (NPRA)](https://linkdigital.com.au/case-studies/norwegian-public-roads-administration-data-portal/) Project snapshot Client: Norwegian Public Roads Administration (Statens vegvesen) Industry: Government / Transportation Core technology: CKAN Open Data Platform Year implemented: 2020 Key solution: Centralised... [Read case study ❯](https://linkdigital.com.au/case-studies/norwegian-public-roads-administration-data-portal/) [![Link Digital case study on IDB's open data portal](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/case-studies/inter-american-development-bank-open-data-catalogue/) ### [CKAN-powered open data catalogue for the Inter-American Development Bank](https://linkdigital.com.au/case-studies/inter-american-development-bank-open-data-catalogue/) Key summary Impact: IDB Global Data Transformation Strategic ROI: Migrated from high-cost proprietary systems to scalable, open-source CKAN, eliminating vendor lock-in. Unmatched performance: Achieved a... [Read case study ❯](https://linkdigital.com.au/case-studies/inter-american-development-bank-open-data-catalogue/) [![Helping the design department of a major European University improve internal data discoverability](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/case-studies/ckan-data-statistics-platform-european-university/) ### [Improved internal data discoverability to help the design department of a major European University](https://linkdigital.com.au/case-studies/ckan-data-statistics-platform-european-university/) Overview Link Digital delivered a tailored CKAN data and statistics platform to improve the internal data organisation and search capacities of the design department of... [Read case study ❯](https://linkdigital.com.au/case-studies/ckan-data-statistics-platform-european-university/) [![Columbia Basin Water Hub - Living Lakes Canada](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/case-studies/columbia-basin-water-hub/) ### [Columbia Basin Water Hub – Living Lakes Canada](https://linkdigital.com.au/case-studies/columbia-basin-water-hub/) About Living Lakes Canada Living Lakes Canada is a charitable water stewardship non-government organisation with over 20 years of experience working with community groups to... [Read case study ❯](https://linkdigital.com.au/case-studies/columbia-basin-water-hub/) 1[2](/wp-admin/admin-ajax.php?action=as_async_request_queue_runner&nonce=371594842e#038;nonce=371594842e&page_num=2)[3](/wp-admin/admin-ajax.php?action=as_async_request_queue_runner&nonce=371594842e#038;nonce=371594842e&page_num=3)…[6](/wp-admin/admin-ajax.php?action=as_async_request_queue_runner&nonce=371594842e#038;nonce=371594842e&page_num=6)[next »](/wp-admin/admin-ajax.php?action=as_async_request_queue_runner&nonce=371594842e#038;nonce=371594842e&page_num=2) --- ### [Ask AI](https://linkdigital.com.au/ask-ai/) **Published:** March 5, 2026 **Author:** Kate Sampher **Excerpt:** Let your users ask questions and get verified answers from your own data. Ask AI by Link Digital is an AI layer for your data portal. **Content:** # Ask AI Transform your data portal into an insight engine Let your users ask questions and get verified answers from your own data. [ Book your AI-readiness audit ](https://linkdigital.com.au/get-in-touch/) ![Ask AI](https://linkdigital.com.au/wp-content/uploads/2026/03/img-ask-AI-LP.png) ## 4-5x Inrease in data accessibility ## 100% Full control ## Zero Public model training The challenge ## Is your data visible in the era of AI? Most data portals act as passive filing cabinets. ![The archive burden](https://linkdigital.com.au/wp-content/uploads/2026/03/solar_atom-line-duotone.png) ## The archive burden Users download 100-page PDFs, manually inspect metadata, and write SQL queries just to find a single answer. Keyword search only works when you already know the publisher’s exact terminology. ![the invisibility risk](https://linkdigital.com.au/wp-content/uploads/2026/03/solar_atom-line-duotone-1.png) ## The invisibility risk When the data portal lacks semantic structure, AI tools cannot retrieve or interpret it accurately. Your datasets become invisible to the systems your users increasingly rely on. ![](https://linkdigital.com.au/wp-content/uploads/2026/03/solar_atom-line-duotone-2.png) ## The global shift Users now expect to ask questions in plain language and get instant, data-backed answers. Portals that only offer file downloads and keyword search are falling behind these expectations. Capabilities ## From data hosting to machine-ready intelligence **01** ## Natural Language Interaction Ask complex questions in plain language. “What was the average carbon emission in this region last year?” receives an instant, data-backed answer. **02** ## Grounded AI (RAG) Using Retrieval-Augmented Generation, the AI is restricted to your verified files. It cannot guess or hallucinate. **03** ## Instant summaries Automatically generate executive summaries from 100-page reports or complex spreadsheets. Turn dense documents into actionable intelligence. Trust and security ## Security and privacy by design **01** ## Private environments Your sensitive data remains within your secure infrastructure. **02** ## Zero public training Your proprietary information is never used to train public models like ChatGPT or Gemini. **03** ## Control You define exactly which datasets the AI can access and who is authorised to query them. ## Book your AI-readiness audit Get in touch today ![Questions](https://linkdigital.com.au/wp-content/uploads/2024/10/questions-section-300x177.webp) ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments --- ### [CKAN and Open Data Portal](https://linkdigital.com.au/ckan/) **Published:** May 24, 2017 **Author:** Steven De Costa **Content:** # Build CKAN data hubs & open data portals Your partner for CKAN-driven data success in your organisation [ Book a call ](https://linkdigital.com.au/get-in-touch/) ## Who we work with ![University of Manitoba](https://linkdigital.com.au/wp-content/uploads/2024/04/01_UM-1.webp) ![Australia Government](https://linkdigital.com.au/wp-content/uploads/2024/04/02_AU-Gov.webp) ![Pacific Community](https://linkdigital.com.au/wp-content/uploads/2024/04/03_Pacific-Community.webp) ![data.gov.au](https://linkdigital.com.au/wp-content/uploads/2024/04/05_data.gov_.au_.webp) ![Living Lakes Canada](https://linkdigital.com.au/wp-content/uploads/2024/04/06_Living-Lakes-Canada.webp) ![NSW Government](https://linkdigital.com.au/wp-content/uploads/2024/04/04_NSW-Government.webp) ![SES NSW State Emergency Service](https://linkdigital.com.au/wp-content/uploads/2024/04/07_NSW-SES.webp) ![Government of South Australia](https://linkdigital.com.au/wp-content/uploads/2024/04/09_Gov-South-Aus.webp) ![Government of Western Australia](https://linkdigital.com.au/wp-content/uploads/2024/04/10_Gov-WA.webp) ![ACT Government](https://linkdigital.com.au/wp-content/uploads/2024/04/11_ACT-Gov.webp) ## What is CKAN? The Comprehensive Knowledge Archive Network or CKAN is an open source data management system that simplifies the process of publishing, sharing, and working with your data. It can be used for both open data portals and internal data hubs. CKAN allows users to catalog, store, and access datasets. It features a user-friendly front end, a comprehensive API for both data and catalog management, visualization tools, and much more. ## We have completely changed the way we think about data. And we have stopped asking ‘why’ data should be shared and are instead asking ‘how’. The importance of data—its social, economic, and environmental benefits—has led to the understanding that data needs to be opened up to its full potential. [**CKAN is a tool that enables this publishing pathway.** ](https://linkdigital.com.au/services/end-to-end-ckan/)Think of a content management system like WordPress, but for data. A means of making data more discoverable, more accessible, and open to deeper and independent analysis, even beyond its original purpose. ### Are you building your CKAN project from scratch? [ Talk to a CKAN expert ](https://linkdigital.com.au/get-in-touch/) ## Why should you choose CKAN? The CKAN data management platform is open source, free, and user community led. Being open source means there are no license fees, and you retain all rights to the data and metadata you enter. It has been adopted by numerous governments, organisations and communities around the world to make their data more discoverable. A focal point for maximising data asset utility. Concentrated attention and quality review checkpoints during both the initial dataset registration and ongoing dataset updates. Existing data management systems can interface directly, over a secure API endpoint. Controlled vocabularies improve metadata quality, and search and access paths. Greater visibility and access to enterprise wide data assets. Data remains valued in it’s local and primary use context while gaining attributes which make it readily available for multiple reuse scenarios. Data access and discovery will improve as each data source is connected. Continuous data investment and return cycles. ## Link Digital and its CKAN expertise ### Link Digital's core tech team are major developers, contributors, and active maintainers of the CKAN project. ### Technical support - Resolution of server and network failures. - Server and network related security patches. - Backups and restores. ### Non-technical support - Helpdesk-style support - Training and documentation - Assistance with data governance - Advice and guidance on potential hosting enhancements - Answering technical questions for the client or, where delegation is provided, for website stakeholders ### Let your data tell the stories. [ Read case studies ](/case-studies) ### CKAN Features ### API CKAN’s Action API is a powerful, RPC-style API that exposes all of CKAN’s core features to API clients. ### DataStore The CKAN DataStore extension provides an ad hoc database for storage of structured data from CKAN resources. ### Geospatial Extensions provide advanced geospatial features, covering data preview, search, and discovery. Ability to preview where structured data with location information is. ### Metadata A CKAN portal provides a rich set of metadata for each dataset. ### Visualisation CKAN’s data previewing tool has a host of powerful features for previewing data stored in the DataStore. ### Publish and manage data An intuitive web interface allows publishers and curators to easily register, update and refine datasets. ### Search and discovery CKAN provides a rich search experience which allows for quick ‘Google-style’ keyword search as well as faceting by tags and browsing between related datasets. ### Filestore FileStore allows users to upload data and image files. ## Request a demo [ Send request ](/get-in-touch) ## Case studies [ Go to case studies ](/case-studies) ## See other capabilities [ Explore ](/expertise) --- ### [Global CKAN experts](https://linkdigital.com.au/global-ckan-experts/) **Published:** August 10, 2026 **Author:** Steven De Costa **Excerpt:** When you work with Link Digital, you are partnering with the architects behind the CKAN software. We have been leading implementers of the CKAN software since 2012. See the Link Digital CKAN experts. **Content:** # Your vision, powered by the global CKAN experts Link Digital doesn't just implement the world's leading open-source data portal platform. We build and improve it. [ Talk to a CKAN Expert ](/get-in-touch/) ![](/wp-content/uploads/2026/08/hero-image.webp) ## CKAN is the world’s leading open source software for data portals and Link Digital is a co-steward. - **Experience:**We have been a CKAN implementer since 2012. - **Core contributor:**We are active developers and contributors to the CKAN software. - **Global reach:**We deliver open data solutions across multiple industries worldwide. ## We are official CKAN co-stewards When you work with Link Digital, you aren’t just hiring a team to install a product. You are partnering with the architects behind the CKAN software. We are proud to be official CKAN co-stewards, dedicating our time, resources, and top engineering talent to ensure the platform remains the global standard for open data management. ![ckan experts datashades](/wp-content/uploads/2026/08/ckan_experts_1.webp) - ### Over a decade of CKAN experience: We have been leading **implementers of the CKAN software since 2012.** We help governments, businesses, not for profits, and universities and research institutions unlock the value of their data. - ### Cross-industry expertise: Data has no borders and neither do we. We have successfully deployed complex, highly customised CKAN open and internal data portals across multiple industries around the world, from healthcare and finance to the public sector and environmental science. - ### Unmatched technical depth: We don’t need to rely on third-party support because **most of the CKAN core tech team are from Link Digital.** When you need a custom extension or complex integration, you are working directly with the people who know the source code best. ## Developing the CKAN roadmap Link Digital doesn’t just talk about the importance of open source software. We do the heavy lifting to shape the future of CKAN software, including the progress of the CKAN 2.12 and CKAN 3.0 roadmaps. From modernising the frontend architecture to streamlining core functionalities, our developers are actively writing the code that powers the next generation of open data portals. When you partner with us, your project benefits from tomorrow’s capabilities, today. [ Explore our CKAN services ](/end-to-end-ckan/) ### CKAN 2.12 Live now - Streamlined core functionalities - Performance and stability improvements ### CKAN 3.0 On the roadmap - Modernised frontend architecture - Next-generation data portal capabilities ## The people behind the platform Our greatest asset is our people. As active developers and contributors to CKAN, our team members are recognised leaders in the open-source community. ![Steven De Costa](/wp-content/uploads/2026/08/steve-de-costa.webp)### Steven De Costa Executive Director [GitHub profile ](https://github.com/Starl3n) ![Sergey Motornyuk](/wp-content/uploads/2026/08/sergey-motornyuk.webp)### Sergey Motornyuk Senior Solutions Architect [GitHub profile ](https://github.com/smotornyuk) ![Ian Ward](/wp-content/uploads/2026/08/ian-ward.webp)### Ian Ward CKAN Core Tech Lead [GitHub profile ](https://github.com/wardi) ![Oleksandr Cherniavskyi](/wp-content/uploads/2026/08/oleksandr-cherniavskyi.webp)### Oleksandr Cherniavskyi CKAN Lead Developer [GitHub profile ](https://github.com/mutantsan) ![Yan Rudenko](/wp-content/uploads/2026/08/yan-rudenko.webp)### Yan Rudenko CKAN Lead Developer [GitHub profile ](https://github.com/Engerrs) ![Iaroslav Pereiaslovets](/wp-content/uploads/2026/08/iaroslav-pereiaslovets.webp)### Iaroslav Pereiaslovets Chief Operations Officer [LinkedIn profile ](https://www.linkedin.com/in/iaroslav-pereiaslovets/) ![Lex Du Plessis](/wp-content/uploads/2026/08/lex-du-plessis.webp)### Lex Du Plessis Technical Delivery Manager [GitHub profile ](https://github.com/lexdu) ![Joel Wigley](/wp-content/uploads/2026/08/joel-wigley.webp)### Joel Wigley Systems Operations Lead [GitHub profile ](https://github.com/joelwigley) ![Anastasiia Shevtsova](/wp-content/uploads/2026/08/anastasiia-shevtsova.webp)### Anastasiia Shevtsova Data Visualisation & UX Lead [LinkedIn profile ](https://www.linkedin.com/in/anastasiia-shevtsova-853b15158/) ![Tome Petrovski](/wp-content/uploads/2026/08/tome-petrovski.webp)### Tome Petrovski Scalable Extension Expert [GitHub profile ](https://github.com/TomeCirun) ![Oleksandr Ivaniuk](/wp-content/uploads/2026/08/oleksandr-ivaniuk.webp)### Oleksandr Ivaniuk CKAN Developer [GitHub profile ](https://github.com/aleks-iv) ![Alex Morev](/wp-content/uploads/2026/08/alex-morev.webp)### Alex Morev CKAN Developer [GitHub profile ](https://github.com/alexmorev) ![Pavlo Malko](/wp-content/uploads/2026/08/pavlo-malko.webp)### Pavlo Malko CKAN Developer [GitHub profile ](https://github.com/PavloMalko) ## Ready to build your next data portal? Whether you’re upgrading your existing infrastructure or developing a new data management initiative, put your trust in the team that continually improve the software. Choose Link Digital, the global CKAN experts. [ Contact us today ](/get-in-touch/) --- ### [Get insights from Link Digital](https://linkdigital.com.au/newsletter/) **Published:** April 22, 2024 **Author:** Kate Sampher **Content:** ## The world of data management is constantly evolving. Whether you're managing public data portals or internal data hubs, Link Digital provides valuable insights and updates on the latest trends to help you stay informed. ## Join the list to receive weekly updates ### We've encountered an error Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments Submit --- ### [Manage your internal data hub](https://linkdigital.com.au/services/internal-data-hub/) **Published:** April 15, 2025 **Author:** Kate Sampher **Content:** # Internal Data Management [ Download the guide ](https://linkdigital.com.au/wp-content/uploads/2024/07/ebook-Transform-your-internal-data-management-with-CKAN-Link-Digital.pdf) Transform your organisation’s data management with secure, scalable, and interoperable solutions from global experts. ![Transform your internal data management with CKAN](https://linkdigital.com.au/wp-content/uploads/2024/07/img-ebook-IDM-1-1024x535.png) ### The challenge of internal data management: how CKAN can help The security of a CKAN internal data management platform can be further enhanced by engaging a third-party service provider, such as Link Digital and by adopting effective data governance and other best practices within the host organisation. [ Read the blog ](https://linkdigital.com.au/news/2024/07/the-challenge-of-internal-data-management-how-ckan-can-help/) ## CKAN-based internal data management Since 2012, Link Digital has been helping organisations worldwide unlock the full potential of their internal data through expertly implemented CKAN solutions. ### Full data lifecycle control From ingestion to archival, you can track every dataset across its journey. ### Built for collaboration From chief data officer to end user, departments and systems; connnect without compromising security. ### Transparency & auditability Maintain compliance with clear access logs and metadata trails. ### Enterprise Security We implement additional layers of protection, including advanced authentication, access controls, and data encryption to ensure your sensitive internal data remains secure. ## Why choose CKAN for your internal data hub? ### Improved data discoverability Advanced metadata management and search capabilities help teams quickly find and access the data they need, reducing time spent on data discovery. ### Enhanced data governance Comprehensive data cataloguing, version control, and access management ensure data quality and compliance with internal policies. ### Collaboration Teams can easily share datasets, collaborate on projects, and maintain data lineage across departments and projects. ### API Robust APIs enable seamless integration with existing tools and workflows, supporting automated data pipelines and custom applications. ### Cost-effective solution Eliminate expensive licensing fees while gaining enterprise-grade functionality. CKAN provides exceptional value for organisations of all sizes. ### Got further questions?  Let’s discuss about your project ![Questions](https://linkdigital.com.au/wp-content/uploads/2024/10/questions-section-e1737530255647.webp) ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments ##### Recent Posts - [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) - [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) - [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) - [When the visitors aren’t human: What rising bot traffic means for your data portal](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) - [From open data to verifiable honesty: An experiment you can look at](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) --- ### [Managed Hosting](https://linkdigital.com.au/services/managed-hosting/) **Published:** July 20, 2017 **Author:** Steven De Costa **Excerpt:** With a focus on high security and affordability, we provide annual hosting account and bi-annual domain registration services in both Linux and Windows environments. **Content:** # Managed Hosting, Support and Maintenance for CKAN and Drupal Portals Your data portal should not need your constant attention. We run the infrastructure, apply the patches, so your team can focus on the data. [Book a consultation](https://linkdigital.com.au/get-in-touch/) [See how the tiers compare](#ldmh-tiers) Monthly health summary state agency portal security patchesassessed and applied infrastructuremonitored, nominal backupsrestore verified CKAN versioncurrent incidents this period0 Illustrative example ## Proactive governance, not reactive tickets Most portal failures are not sudden. They accumulate over time. A deferred security patch. An unmonitored disk. A CKAN version that drifts three releases behind until an upgrade stops being a task and becomes a major project. Link Digital operates your portal on AWS infrastructure that we architect, maintain, and monitor ourselves. We have over a decade of experience working on Drupal and CKAN deployments on AWS. As co-stewards of the CKAN project, we do not wait for release notes. Our engineers work inside the project that produces them. Security advisories reach us as they are prepared, and your environment is assessed against them as part of our managed hosting service, rather than as an escalation when things go wrong. What this covers: - Security patch assessment and application - Infrastructure monitoring, alerting, and incident response - Backup and restore verification, not simply backup scheduling - CKAN version currency, so that upgrades stay routine rather than becoming migrations - Performance monitoring across the portal and its supporting services ## One agreement, one team, two platforms Organisations running portals that feature a combination of CKAN for data management and Drupal for their public-facing content management typically must hold two contracts with two vendors. When something breaks in the seam between them, the first hour goes to establishing whose problem it is. That hour is billed to you twice, and it is incurred by your staff trying to figure out the problem. Link Digital supports both platforms with a single agreement. One team. One escalation path. One invoice. Alongside hosting, support, and maintenance, our agreements also include a full suite of enterprise account management services: roadmapping, cross-briefing of new requirements between your teams and ours, and regular meetings that keep priorities visible on both sides. Support hours are drawn from a monthly allocation. They can be spent on incidents, scheduled maintenance, or planned enhancement work, according to what your portal needs that month. CKANdata management Drupalpublic content ↓ A single agreement one teamone escalation pathone invoice ## Support tiers The tiers below describe the shape of an engagement, not a fixed product. Each is illustrated with a scenario drawn from the kinds of portals we operate. Find the one that resembles yours. Essential 5 to 10 hours per month For stable portals that need to stay stable Example: a state agency portal, three years live Around forty datasets, updated quarterly, with no development roadmap. Most months have no incidents. The hours go to patch assessment, monitoring, backup restore verification, and a short written health summary. The team learns a patch was applied by reading it. **This tier fits you if:** Your portal is stable, your dataset volume is predictable, and your principal risk is neglect rather than change. Standard 15 to 25 hours per month For portals that are still growing Example: a university research institute onboarding new publishing teams Launched for one faculty, now expanding to four, each team bringing its own metadata conventions and a harvester to configure. Everything in Essential, plus enhancement work: schema changes, harvester configuration, extension updates, theming, and security updates, with a quarterly roadmap review. **This tier fits you if:** The portal is still evolving and the changes are frequent enough that raising a quote for each one has become a bottleneck. Enterprise 30 or more hours per month For portals that are critical infrastructure Example: a whole-of-government data portal with statutory obligations Multiple agencies publishing data, with sovereignty and data security requirements and accessibility compliance under formal audit. Everything in Standard, plus account management: roadmapping, cross-briefing, regular meetings, priority escalation, and dedicated engineering capacity. **This tier fits you if:** The portal is infrastructure, not just a website, and its failure would be someone else's problem before it was yours. [Book a consultation](https://linkdigital.com.au/get-in-touch/) ## FAQ What is included in CKAN-managed hosting?Infrastructure provisioning and monitoring on AWS, security patch assessment and application, backup and restore verification, CKAN version currency, and support for incidents affecting portal availability. Do you support Drupal as well as CKAN?Yes. Both platforms are supported under a single agreement, with one team, one escalation path and one invoice. Agencies running a CKAN data portal alongside a Drupal public site do not need to engage two vendors. Can you take over a portal that was built by someone else?Yes. Portals frequently transition to us from another provider or from an in-house team that no longer has the capacity to maintain them. How much does managed hosting cost?Pricing is scoped per engagement because infrastructure footprint and complexity vary substantially between portals. Support tiers begin at 5 to 10 hours per month. We provide an indicative range in the first conversation. Why does CKAN co-stewardship matter for hosting?Co-stewardship means our engineers don't just work on CKAN; we are inside the software, working on its maintenance and next phase. So patch assessment for your portal begins from a deep understanding rather than from investigation. What happens if our CKAN version falls out of support?The CKAN Tech Team stops issuing security patches for it. The portal continues to run, but newly disclosed vulnerabilities affecting your version will not be fixed upstream. Every service tier includes planning upgrades before the support window closes. Our pricing is scoped per engagement. Infrastructure, dataset volume, and integration complexity vary enough between portals that a published figure would mislead more often than it would help. Tell us which scenario resembles yours, and we will give you an indicative range in our first conversation. [Book a consultation](https://linkdigital.com.au/get-in-touch/) [ View AWS Hosting Environment for CKAN ](https://linkdigital.com.au/wp-content/uploads/2024/10/CKAN-Architecture-e1730359076456.png) [ View AWS Hosting Environment for Drupal ](https://linkdigital.com.au/wp-content/uploads/2024/08/Secure_AWS_Architecture.jpg) ## Request a demo [ Send request ](/get-in-touch) ## Case studies [ Browse library ](/case-studies) ## More services? [ See other capabilities ](https://linkdigital.com.au/products-services/) --- ### [About Link Digital](https://linkdigital.com.au/about-us/) **Published:** December 8, 2025 **Author:** Steven De Costa **Excerpt:** We are active CKAN maintainers, implementers, developers, and contributors. We provide data consulting and build capability for data repository management. **Content:** # About Link Digital [ Get in touch ](https://linkdigital.com.au/get-in-touch/) Link Digital is a globally focused technology information company and official co-steward of the CKAN project, the world’s most advanced open-source data management system. ![link about](https://linkdigital.com.au/wp-content/uploads/2025/03/link-about-1024x1024.png) ## Who we are ### We are leaders Since 2001, Link Digital has helped governments and international organisations solve real-world problems by building high-quality, scalable digital infrastructure. As developers, implementers, and contributors to CKAN and Open Data since 2012, Link Digital provides expert consulting, managed hosting, UI/UX design, and build capability for data repository management. Our team of dedicated professionals focuses on making data discoverable, searchable, and easy to interpret to help our clients make sound decisions and solve real-world problems. ### We know data Our expertise lies in all elements of data management: - Data architecture, including metadata, indexing, cataloguing and dataset management - Web and UI design and development for dynamic data manipulation and visualisation - Integration to a range of database and data management technologies, and data workflow development - Combining data management systems with content management systems - Cloud computing and hosted environments. We combine this with our deep knowledge of CKAN, and our Agile methodology to deliver successful project outcomes at all levels of scale, from point solutions to cloud-based enterprise implementations. Creativity Results Honesty Mastery Team ### **Creativity** We find the joy of innovation in all we do. Equipped with curiosity, passion, and dedication to our mission, we strive to be creative rather than reactive to effectively solve problems and generate ideas that add unique value for our clients. ### **Results** Our team steps to a beat of purpose and commitment, at our heart, to deliver a results driven service for clients. Our clients trust us to provide solutions that work, and as a team, we do our best to produce high quality, agreed-upon results. ### **Honesty** It’s a simple truth, honest business is good business. We work collectively as professional and ethically aligned teammates who act with integrity to deliver transparency. Honesty is imperative to our success and developed relationships. ### **Mastery** We continue to learn, practice and teach to release our best. Where others see adversity and challenges, we see opportunities to foster growth. Our focus, consistency and persistence has propelled us to be amongst the leaders in a number of specialised digital practices. ### **Team** We work together with discipline and determination to make Link Digital the best it can be. Combining a diverse set of expertise, our cross-functional teams communicate and collaborate in order to achieve success and drive innovation. Built with a mission to create meaningful change for our staff, clients and the community; our five core values are at the heart of everything we do. Results Our team steps to a beat of purpose and commitment, at our heart, to deliver a results driven service for clients. Our clients trust us to provide solutions that work, and as a team, we do our best to produce high quality, agreed-upon results. Mastery We continue to learn, practice and teach to release our best. Where others see adversity and challenges, we see opportunities to foster growth. Our focus, consistency and persistence has propelled us to be amongst the leaders in a number of specialised digital practices. Honesty It’s a simple truth, honest business is good business. We work collectively as professional and ethically aligned teammates who act with integrity to deliver transparency. Honesty is imperative to our success and developed relationships. Team We work together with discipline and determination to make Link Digital the best it can be. Combining a diverse set of expertise, our cross-functional teams communicate and collaborate in order to achieve success and drive innovation. Creativity We find the joy of innovation in all we do. Equipped with curiosity, passion, and dedication to our mission, we strive to be creative rather than reactive to effectively solve problems and generate ideas that add unique value for our clients. [View our work](https://linkdigital.com.au/case-studies/) [ ](# "Previous") [ ](# "Next") ## Leadership team ![Image of Steven](https://linkdigital.com.au/wp-content/uploads/2025/03/Steven.png) **Steven De Costa** Executive Director [ ](https://www.linkedin.com/in/stevendecosta) ![Suk Khamb-Tanganco - Head of Business Services at Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/05/Suk-Pic-Grey-BG.png) Suk Khamb-Tanganco Head of Business Services [ ](https://www.linkedin.com/in/sukwinder-kour-khamb-tanganco-bb5b82148/) ![Image of Iaroslav](https://linkdigital.com.au/wp-content/uploads/2025/03/Iaroslav.png) **Iaroslav Pereiaslovets** Chief Operations Officer [ ](https://www.linkedin.com/in/iaroslav-pereiaslovets-a9053258/) ![Image of Kate](https://linkdigital.com.au/wp-content/uploads/2025/03/Kate.png) **Kate Sampher** Chief Marketing Officer [ ](https://www.linkedin.com/in/katrinasampher/) ## Our way of working At Link Digital, our way of working is heavily influenced by our vision: To create meaningful change and we do this by remaining true to our core values. As a company with a largely distributed and growing team globally, with a similarly distributed list of clients growing around the world, our day-to-day operations are supported by tools and strong engagement with open communities. #### **As CKAN co-stewards** We are highly engaged as a [co-steward of the CKAN open source project](http://ckan.org/), with key CKAN staff directly involved in the Governance, community, and technical teams. This involvement benefits our clients as we act as proxy for their interest in CKAN’s technical roadmap, update releases, and sustainability initiatives. [ See Professional Services ](https://linkdigital.com.au/products-services) #### **As an agile team** We employ [Scrum methodology](http://scrummethodology.com/) with work managed via two-week sprints. [Jira](http://jira.com/) provides our clients with direct and immediate transparency over work in progress and offers the opportunity for further collaboration. #### **Our global team** With employees located in a variety of time zones, we run global project teams and fit some aspects of our ‘way of working’ to align with our client timezones. To communicate with empathy through non-verbal cues, we encourage the use of video conferencing for meetings, client briefings, business analysis, consulting, training and feature/story elaboration. We also run internal scrum stand-ups, backlog elaboration and retrospectives. ## Building a data portal? Get in touch ![data portal](https://linkdigital.com.au/wp-content/uploads/2025/03/data-portal.png) ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments --- ### [Get In Touch](https://linkdigital.com.au/get-in-touch/) **Published:** May 23, 2017 **Author:** Steven De Costa **Excerpt:** Link Digital is the trusted CKAN expert globally. They work with governments, NGOs, academic and research institutions worldwide. **Content:** ## Get in touch ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments ### Already an existing customer? [ Contact our helpdesk ](https://helpdesk.links.com.au/index.php) ### **Head office** **Canberra** Postal Address: PO Box 4010 Hawker ACT 2614 Australia Phone: +61 2 6111 2907 Link Digital is a registered trading name of the Australian company, Link Web Services Pty Ltd. —————————- **Toronto, Ontario, Canada** Phone: +1 (343) 8833051 Link Digital is also a registered business name of our subsidiary Canadian company, Datashades Ltd. ![Data portal maintenance](https://linkdigital.com.au/wp-content/uploads/2026/08/Data-portal-maintenance-1024x535.jpg) #### About Link Digital Link Digital is a globally focused open information company and official co-steward of the CKAN project, the world’s most advanced open-source data management system. Since 2001, Link Digital have helped governments and international organisations solve real-world problems by building high-quality, scalable digital infrastructure. As developers, implementers, and contributors to CKAN since 2012, Link Digital provides CKAN hosting, support, and maintenance, as well as consulting and UI/UX design services. [ Facebook ](https://www.facebook.com/LinkDigital/) [ Youtube ](https://www.youtube.com/@link-digital) [ Linkedin ](https://www.linkedin.com/company/link-digital/) --- ### [Services](https://linkdigital.com.au/products-services/) **Published:** May 23, 2017 **Author:** Steven De Costa **Excerpt:** Link Digital is a globally focused open information company and official co-steward of the CKAN project, the world’s most advanced open-source data management system. Since 2001, they have helped governments and international organizations solve real-world problems by building high-quality, scalable digital infrastructure. **Content:** # Open source technology experts, globally. Creating and improving data hubs and portals through open source technologies. [ Talk to an expert ](https://linkdigital.com.au/get-in-touch/) ![2001 EST](https://linkdigital.com.au/wp-content/uploads/2024/09/2001-EST.svg) Established in 2001, Link Digital is a globally focused open information company helping government, NGO, and large organisations make meaningful change through data. Applying Infrastructure as a Code (IaC) approach allows our DevOps team to efficiently manage applications even with the most sophisticated infrastructure code. Our customers include government, commercial and non-profit organisations. ## Services ![Ask AI](https://linkdigital.com.au/wp-content/uploads/2026/03/img-ask-AI-LP-300x153.png) ## Ask AI S**marter CKAN data portals:** Let your users ask questions and get verified answers from your data. [ Request demo ](https://linkdigital.com.au/ask-ai/) ![Data visualisation and dashboard for Living Lakes Canada with Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/10/LLCA-blog-image-768x401.jpg) ## End-to-end CKAN Services From consultancy, hosting, support and maintenance [ Talk to us ](https://linkdigital.com.au/services/end-to-end-ckan/) ![icon-organisation reports](https://linkdigital.com.au/wp-content/uploads/2024/12/icon-CDP-report-arrow-up-150x150.png) ## CKAN migration Planning to replace your legacy data management system? [ Discover how ](https://linkdigital.com.au/services/move-to-ckan/) ![Climate data portal](https://linkdigital.com.au/wp-content/uploads/2025/05/img-Climate-Data-Lex-287x150.webp) ## Climate Data Hubs & Portals Manage and measure your climate datasets with open source technologies. [ Read more ](https://linkdigital.com.au/services/environment-climate/) ![Secure data exchange](https://linkdigital.com.au/wp-content/uploads/2024/09/preview-secure-data-exchange.svg) ## Secure Data Exchange Your platform to exchange, categorise and secure your organisation’s data. [ Discover more ](https://linkdigital.com.au/services/secure-data-exchange/) ![Link Digital, the trusted CKAN and open data portal expert](https://linkdigital.com.au/wp-content/uploads/2024/09/Internal-data-management.svg) ## Internal data hubs Transform your internal data management with CKAN [ Explore how ](https://linkdigital.com.au/services/internal-data-hub/) ![Accountable open data portal experts - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/09/Managed-Hosting.svg) ## Managed Hosting Find your solution for both Drupal and CKAN deployments [ Read more ](https://linkdigital.com.au/services/managed-hosting/) ![Application Development](https://linkdigital.com.au/wp-content/uploads/2024/09/Application-Development.svg) ## Application Development Let’s bring your ideas to life [ Get started ](https://linkdigital.com.au/services/application-development/) ![Product Development](https://linkdigital.com.au/wp-content/uploads/2024/09/Product-Development.svg) ## Product Development Your great product starts right here [ Discover how ](https://linkdigital.com.au/services/product-development/) ## Book a consultation [ Get in touch ](/get-in-touch) ## Case studies [ Explore library ](/case-studies) --- ### [The Honest Series Episode 01 - The Theory of Complex Systems](https://linkdigital.com.au/the-honest-series-01-the-theory-of-complex-systems/) **Published:** June 17, 2026 **Author:** Steven De Costa **Content:** The Honest Series # Does the system lie to itself? The Theory of Complex Systems Where data, decisions, and honest thinking meet. Wednesday, July 8 | 1:00 PM AEST ## About the series The Honest Series is Link Digital’s conversation series for data managers in government, research institutions, NGOs, and academia who are tired of webinars that read like sales pitches. Our promise is simple. Candid conversations and useful takeaways. Each session will bring together data practitioners and thinkers across three pillars: complex systems, data sovereignty, and open data. Sometimes the topic will sit at the intersection of the science of decision-making or the design of open data systems. At others, we will discuss the technical details of how data sovereignty gets implemented in practice or how to build an open data portal that earns public trust. All of them will involve honest discussion about what works and what doesn’t, and what you might need to think about next. ## Opening session Wednesday, July 8 | 1:00 PM AEST ### Does the system lie to itself? The Theory of Complex Systems A live conversation on what honest assessment looks like inside complex systems, networks, and the data we depend on to make decisions. We will explore the gap between how systems describe themselves and how they actually behave, and what that means for the people building data infrastructure and the people relying on it. ### What to expect - Live online - 30- to 45-minute conversation - Moderated audience Q&A - Recording sent to all registrants ## Guest speaker ![Simon Atkinson - The Honest Series by Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/06/Simon-Blue-BG.png) ## Simon Reay Atkinson Simon Reay Atkinson works at the intersection of complex systems research and applied practice. He is an Adjunct Honorary Associate Professor at the University of Sydney’s Centre for International Security Studies, a Captain in the Royal Australian Navy Reserves where he serves as Principal Researcher, and a Fellow of the [Institute of Engineering and Technology](https://www.theiet.org/). His PhD from the University of Cambridge examined adaptation and fitness in complex adaptive systems across cyber, political, security, and economic domains. This work built on an earlier Master of Philosophy, also from University of Cambridge in International Relations, Law and Economics, and an earlier undergraduate degree in engineering. He has described his approach as bringing engineering and social science lenses together, with an emphasis on the practical re-use of research. ## Who should attend - Government data managers, Chief Data Officers, and policy teams - Data and IT teams at research institutions - NGOs working with open or public-interest data - Academic and public sector data practitioners - Anyone working on or thinking about data sovereignty ## Register to attend Recording will be sent to all registrants. ### We've encountered an error Email Name Organisation Role Questions Yes, I'd like to receive marketing emails from Link Digital about The Honest Series and future updates. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/). Comments ## Frequently asked questions ### Why "The Honest Series"? Many webinars in this space are product pitches dressed as discussion. This series is not. Each session will involve a candid conversation on what works and what doesn’t and what you need to think about next. ### Is this session live? Yes. ### What if I cannot make it live? We will share the recording within 24-48 hours. ### Will I receive the recording? Yes, you will receive the recording; you just have to register. ### Who is this for? It is for data managers in government, research institutions, NGOs, and academia who are responsible for open data and decision-making and the technology that underpins this work. --- ### [Move to CKAN](https://linkdigital.com.au/services/move-to-ckan/) **Published:** August 1, 2025 **Author:** Kate Sampher **Excerpt:** Unreliable data management system? Switch to CKAN. Migration shouldn't be a hassle. Link Digital can help. Join hundreds of data portals around the world. **Content:** ## Migrate to CKAN Full-service migration: from planning, metadata cleanup with zero downtime. [ Request for consultation ](/get-in-touch) ![Publish data on CKAN with Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/10/ckan-logo-1-380x380.webp "CKAN & Open Data") [ ![Canadian Watershed Information Network - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/07/CanWIN-Cover-768x403.jpg) ](https://canwin-datahub.ad.umanitoba.ca/) ![Link Digital is trusted by the University of Manitoba](https://linkdigital.com.au/wp-content/uploads/2024/07/UNIM-CEOS-logo.svg) ## CKAN migration success story *“CKAN customised schemas have allowed us to be searchable by Google dataset searches and other global partners, which is key to the findability of our datasets. Being able to build it into our metadata templates saves us significant time and allows us to let our users fill in the forms.* *The user permissions allow us to provide data sovereignty to various groups and give them granular control over their data.”* **– Claire Herbert, Head of Digital Strategy, Faculty of Centre for Earth Observation Science, University of Manitoba** [ Read the case study ](https://linkdigital.com.au/case-studies/canadian-watershed-information-network-canwin/) [ From collecting data to telling stories ](https://linkdigital.com.au/news/2025/04/from-collecting-data-to-telling-stories-a-cost-effective-journey-in-freshwater-data-management/) ## Ready to move? [ Talk to an expert ](/get-in-touch) ## See migration checklist [ Download now ](https://linkdigital.com.au/wp-content/uploads/2024/07/Migrate-your-data-hub-to-CKAN.pdf) ## Work with the right CKAN partner ![metadata](https://linkdigital.com.au/wp-content/uploads/2024/07/img-metadata-768x612.png) ## Why CKAN? Metadata management Utilise advanced descriptive metadata and cataloguing features, including specific keywords and metadata tags, to organise and classify internal data sets. ### Workflow management Monitor data usage and metrics by creating real-time reports and dashboards, and efficiently automate data management tasks like approval and updates. ![CKAN Co-Steward](https://linkdigital.com.au/wp-content/uploads/2019/11/CKAN-Co-Steward-Link-Digital-2-300x132.png) ## CKAN experts to guide your move [ Talk to a CKAN expert ](https://linkdigital.com.au/home/get-in-touch/) ![CKAN API Access](https://linkdigital.com.au/wp-content/uploads/2024/07/img-API-access-300x200.png) ### API integration A RESTful API allows developers to interact with all aspects of its open data platform, including extension development and the easy migration of data from other services and systems, including legacy systems. ### Advanced access controls Set permission settings to control critical and sensitive internal data at a group or individual level, to fit the needs of a particular project or your organisation more generally. ![Data Chart](https://linkdigital.com.au/wp-content/uploads/2024/07/img-data-viz-300x200.png) ### Greater data visualisation Enable greater data visualisation by utilising extensions designed to integrate seamlessly with the user’s existing data tools. ### ### Easy customisation CKAN is also highly customisable through a [wide variety of extensions](https://extensions.ckan.org/) that can increase its basic functionality and integrate in a seamless manner with a user’s existing data and digital operations. ## Talk to Link Digital CKAN experts [ Send a message ](https://linkdigital.com.au/home/get-in-touch/) ## Join hundreds of data portals around the world. Get in touch today ![Questions](https://linkdigital.com.au/wp-content/uploads/2024/10/questions-section-300x177.webp) ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments ![Secure Data Exchange](https://linkdigital.com.au/wp-content/uploads/2024/06/image-secure_data_exchange-1-e1723565284524-300x169.png) ### Secure Data Exchange [ Tell me more ](https://linkdigital.com.au/services/secure-data-exchange/) ![government open data portals](https://linkdigital.com.au/wp-content/uploads/2024/05/blog-img-government-open-data-portals-300x169.png) ### Government Open Data Portals [ A look at CKAN and Socrata ](https://linkdigital.com.au/news/2024/05/government-open-data-portals-a-look-at-ckan-and-socrata/) ![Open source tech and government data management](https://linkdigital.com.au/wp-content/uploads/2024/07/img-opensource_for_government_720-300x169.png) ### Open source technology is the best fit for government data management [ Discover why ](https://linkdigital.com.au/news/2024/07/why-open-source-technology-is-the-best-fit-for-government-data-management/) - [Recent](#recent-posts-tab-2143) - [Popular](#popular-posts-tab-2143) - [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) September 11, 2026 - [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) September 3, 2026 - [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) August 26, 2026 - [Planning a Drupal upgrade in 2026? Here is what you need to know](https://linkdigital.com.au/news/2026/05/planning-a-drupal-upgrade-in-2026-here-is-what-you-need-to-know/) May 6, 2026 902 Views - [What is the future of open data in the AI era?](https://linkdigital.com.au/news/2026/03/what-is-the-future-of-open-data-in-the-ai-era/) March 18, 2026 834 Views - [Making data portals user-friendly: a conversation with a UI/UX expert](https://linkdigital.com.au/news/2026/03/making-data-portals-user-friendly-a-conversation-with-a-ui-ux-expert/) March 17, 2026 691 Views [ Facebook ](https://www.facebook.com/LinkDigital/) [ Youtube ](https://www.youtube.com/@link-digital) [ Linkedin ](https://www.linkedin.com/company/link-digital/) ## About Link Digital *Established in 2001, Link Digital is the trusted partner of governments, NGOs, and enterprise organizations in building data hubs and open data portals.* As developers, implementers, and major contributors to CKAN since 2012, Link Digital provides CKAN hosting, support, and maintenance, as well as consulting and design services. Their team makes data discoverable, searchable, and easy to interpret, helping organizations make sound decisions and solve real-world problems. --- ### [Open Source Technologies for Government](https://linkdigital.com.au/services/industries/open-source-government/) **Published:** April 24, 2025 **Author:** Kate Sampher **Excerpt:** Reduce costs while improving the digital infrastructure of government agencies. See success stories. Read case studies. Download the guide. **Content:** ## Open source technologies for government Reduce costs while improving your digital infrastructure [ Request a live demo ](/get-in-touch) ![Open source technologies for government](https://linkdigital.com.au/wp-content/uploads/2025/04/hero-image-OSS-gov-2.png) ## Data is now central to the business of government Governments are collecting more data than ever before and using it to work efficiently. To do so, they require flexible solutions to help catalogue, discover, and make sense of their data and share it internally and publicly. ## Download guide This eBook provides practical insights, real-world case studies, and strategies to help public sector leaders implement scalable, secure, and cost-effective digital infrastructure. *Please complete the form below to receive your download link.* Modern Contact Form ## Get in touch **Thank you!** Your message has been sent successfully. We'll get back to you soon. Name Email Title Organisation Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/). Comments Submit ![ebook: open source technologies for government](https://linkdigital.com.au/wp-content/uploads/2025/04/cover-download-ebook-OOS-gov.png) ## Today's challenges ### Public data silos ### Legacy lock-in ### Increasing licensing fees ## Why use open source technologies ![No vendor lock in](https://linkdigital.com.au/wp-content/uploads/2025/04/icon-archive.png)### No vendor lock in Eliminate this risk by giving users the freedom to modify, upgrade, tailor, or combine solutions. ![easier customisation and control](https://linkdigital.com.au/wp-content/uploads/2025/04/icon-encrypted-data.png)### Easier customisation and control Allow your data managers to easily see what data is stored in their system and manage data assets across multiple departments, organizational branches, and internal and external data users in a secure access environment. ![lower cost](https://linkdigital.com.au/wp-content/uploads/2025/04/icon-lower-cost-150x150.png)### Lower total cost Remove the need to pay licensing fees and offers additional cost savings. ## Trusted by ![Australia Government](https://linkdigital.com.au/wp-content/uploads/2024/04/02_AU-Gov-300x200.webp) ![Open source technologies for government](https://linkdigital.com.au/wp-content/uploads/2025/04/NPRA-logo-grayscale-2-200x200.png) ![Government of South Australia](https://linkdigital.com.au/wp-content/uploads/2024/04/09_Gov-South-Aus-300x200.webp) ![Government of Western Australia](https://linkdigital.com.au/wp-content/uploads/2024/04/10_Gov-WA-300x200.webp) ![ACT Government](https://linkdigital.com.au/wp-content/uploads/2024/04/11_ACT-Gov-300x200.webp) ![NSW Government](https://linkdigital.com.au/wp-content/uploads/2024/04/04_NSW-Government-300x200.webp) ## Got further questions?  ![Questions](https://linkdigital.com.au/wp-content/uploads/2024/10/questions-section-768x453.webp) ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments ## About Link Digital *Established in 2002, Link Digital is the trusted partner of governments, NGOs, and enterprise organizations in building data hubs and open data portals.* As developers, implementers, and major contributors to CKAN since 2012, Link Digital provides CKAN hosting, support, and maintenance, as well as consulting and design services. Their team makes data discoverable, searchable, and easy to interpret, helping organizations make sound decisions and solve real-world problems. [ Facebook ](https://www.facebook.com/LinkDigital/) [ Youtube ](https://www.youtube.com/@link-digital) [ Linkedin ](https://www.linkedin.com/company/link-digital/) --- ### [Practitioner Page](https://linkdigital.com.au/ooi-experiments/) **Published:** January 14, 2026 **Author:** Kate Sampher **Content:** ## Build the system that builds itself Join the Objective Observer Initiative (OOI) experiments. This is a community of makers building the next generation of civic tech. Public digital platforms in which digital accountability is not only legal or contractual, but it’s observable, communicable, and subject to the verifiability of its own claims. [ Join the next Block Build ](https://groups.google.com/a/linkdigital.com.au/g/OdiousX/) ![](https://linkdigital.com.au/wp-content/uploads/2026/01/image-13.png) ## Why join the OOI? You have skills. The OOI is a live experiment. We aren’t just coding tickets; we are building tools to help communities understand themselves. ![](https://linkdigital.com.au/wp-content/uploads/2026/01/image-16-1024x1024.png) **Growth:** Learn new ways to work with AI and data. ![](https://linkdigital.com.au/wp-content/uploads/2026/01/image-17-1024x1024.png) **Structure:** Join our regular ‘Block Builds’ focused sessions where we get things done. ![](https://linkdigital.com.au/wp-content/uploads/2026/01/image-18-1024x1024.png) **Meaning:** Build technology that supports democracy and truth. ## Let’s build and create. We believe in “doing”. The Agent-AI Team: Learn to code and create alongside AI partners. The Block Build: Once a week we meet to build. No bureaucracy, just output. The Experiments: Help us test new ideas on [opendata.ly](https://opendata.ly/) (our social layer) and [opendata.ai](https://opendata.ai/) (our observer tool). ![](https://linkdigital.com.au/wp-content/uploads/2026/01/image-15.png) ## Join the initiative We are looking for the early adopters. The ones who shape the culture of information. If you are tired of the status quo and want to build optimistic data, this is your place. ## Ready to build? Let's get started. The next experiment starts soon. We can’t wait to see the results it will bring. Let’s work together to come up with a solution. [ Join the Google Group ](https://groups.google.com/a/linkdigital.com.au/g/OdiousX/) --- ### [News](https://linkdigital.com.au/news/) **Published:** May 23, 2017 **Author:** Steven De Costa **Content:** Filters - All articles + - Industry + - Environmental/Climate Change + - Government + - Higher Education/Research + - Non-profit/NGO + - Objective Observe Initiative + - Resources + - Tutorial + - Technology Infrastructure + - Amazon Web Services (AWS) + - CKAN + - Drupal + - Microsoft Azure + - Thought Leadership + - Kate Sampher + - Steven De Costa + - Topics + - Artificial Intelligence + - DCAT (Data Catalog Vocabulary) + - Digital Public Infrastructure + - Environmental/Climate Change + - Geospatial + - Internal data hub + - Open Data + - Smart City + Sort by defaultSort by title: alphabeticalBy date: newest firstBy date: oldest first [![Post Image Placeholder](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) ### [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) Rising bot traffic is not only a question of volume and cost. A large and growing share of it is harmful, and much of that... ![Kate Sampher](https://secure.gravatar.com/avatar/52d7dd9db65d5ed852c0dd29dcac62d436238ac326e1456d5b47f01832cd8107?s=48&d=mm&r=g) Kate Sampher [Read More ❯](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) [![Post Image Placeholder](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) ### [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) CKAN 2.12 has been officially released. The potentially final release in the 2.x series delivers improvements to file management, DataStore performance, and the user interface,... ![Kate Sampher](https://secure.gravatar.com/avatar/52d7dd9db65d5ed852c0dd29dcac62d436238ac326e1456d5b47f01832cd8107?s=48&d=mm&r=g) Kate Sampher [Read More ❯](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) [![Diagram of data workflow: Dataset → Attribution with overlapping UI screens and arrows illustrating provenance steps.](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) ### [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) It’s no secret that as the open data movement enters its third decade, traditional data platforms are dealing with a profound structural shift. For the... ![Andrew Nette](https://linkdigital.com.au/wp-content/uploads/2025/05/andrew-nette_avatar-48x48.jpg) Andrew Nette [Read More ❯](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) [![Arrows converging toward a blue shield with a white lock, symbolizing cybersecurity on a light blue gradient background](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) ### [When the visitors aren’t human: What rising bot traffic means for your data portal](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) Over the past several months we have watched a clear shift in the traffic reaching the sites and portals we work with. A growing share... ![Kate Sampher](https://secure.gravatar.com/avatar/52d7dd9db65d5ed852c0dd29dcac62d436238ac326e1456d5b47f01832cd8107?s=48&d=mm&r=g) Kate Sampher [Read More ❯](https://linkdigital.com.au/news/2026/08/when-the-visitors-arent-human-what-rising-bot-traffic-means-for-your-data-portal/) [![From open data to verifiable honesty_ An experiment you can look at](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) ### [From open data to verifiable honesty: An experiment you can look at](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) For many years the promise of open data was simple: make your data public, make it shareable, and good things follow. I still believe this.... ![Kate Sampher](https://secure.gravatar.com/avatar/52d7dd9db65d5ed852c0dd29dcac62d436238ac326e1456d5b47f01832cd8107?s=48&d=mm&r=g) Kate Sampher [Read More ❯](https://linkdigital.com.au/news/2026/08/from-open-data-to-verifiable-honesty-an-experiment-you-can-look-at/) [![Drupal upgrade screen with 'Upgrading...' and a progress bar beside a calendar page marked December 2026, LINKDIGITAL.](https://linkdigital.com.au/wp-content/plugins/better-post-filter-widgets-for-elementor/assets/images/BPFWE-Placeholder-Image-3-2.png)](https://linkdigital.com.au/news/2026/08/getting-ahead-of-the-deadline-to-upgrade-your-drupal-capability/) ### [Getting ahead of the deadline to upgrade your Drupal capability](https://linkdigital.com.au/news/2026/08/getting-ahead-of-the-deadline-to-upgrade-your-drupal-capability/) While the Comprehensive Knowledge Archive Network or CKAN is vital to Link Digital’s work on data catalogues and open data platforms, we often use it... ![Andrew Nette](https://linkdigital.com.au/wp-content/uploads/2025/05/andrew-nette_avatar-48x48.jpg) Andrew Nette [Read More ❯](https://linkdigital.com.au/news/2026/08/getting-ahead-of-the-deadline-to-upgrade-your-drupal-capability/) 1[2](/wp-admin/admin-ajax.php?action=as_async_request_queue_runner&nonce=371594842e#038;nonce=371594842e&page_num=2)[3](/wp-admin/admin-ajax.php?action=as_async_request_queue_runner&nonce=371594842e#038;nonce=371594842e&page_num=3)…[34](/wp-admin/admin-ajax.php?action=as_async_request_queue_runner&nonce=371594842e#038;nonce=371594842e&page_num=34)[next »](/wp-admin/admin-ajax.php?action=as_async_request_queue_runner&nonce=371594842e#038;nonce=371594842e&page_num=2) --- ### [Transform your university's data management with CKAN & Link Digital](https://linkdigital.com.au/services/industries/universities-research/) **Published:** September 24, 2025 **Author:** Kate Sampher **Content:** # University data management Transform your institution’s data portal with CKAN & Link Digital’s data management solutions [ Get in touch ](/get-in-touch) [ Download guide ](https://linkdigital.com.au/wp-content/uploads/2025/10/A-Guide-to-CKAN-for-Universities_Link-Digital.pdf) ![Helping the design department of a major European University improve internal data discoverability](https://linkdigital.com.au/wp-content/uploads/2025/10/Image-EU-Uni--1024x536.webp) ![Transform your university’s data management with CKAN & Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/10/bc24b878d32d6699176a16869edfe5f58f8e40f2-1024x719.png) ## Discover the full potential of your research data Universities generate large amounts of valuable research data daily, but too often this data remains difficult to manage, difficult to discover, and underutilised. What if your institution could transform this challenge into a competitive advantage? CKAN, actively developed and maintained by Link Digital, provides universities with a comprehensive data management platform that turns data chaos into shareable research outcomes and strategic insight. ## Why universities choose CKAN #### **For research excellence** - Enhanced data discoverability - Cross-disciplinary collaboration - Research impact measurement - Global research partnerships #### **For IT & data management teams** - Improved metadata quality - Secure, controlled sharing - Seamless scalability - Enhanced interoperability #### **For university management** - Institutional visibility - Comprehensive data insights - Data-driven research ## Use cases in data excellence See how universities worldwide improve data management, collaboration, and impact with CKAN. Discover success stories of universities and research communities managing and sharing data on a global scale. ![Pacific Data Hub case study by Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/10/img-LP-ckan-uni-PDH-1920-x1080-1024x576.webp) ## Pacific Data Hub - The Pacific Community A digital platform that enables researchers to access and share data, conduct analysis, and inform policy within the region. [ Read case study ](https://linkdigital.com.au/case-studies/pacific-data-hub/) ![University of Manitoba & CKAN case study by Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/10/img-LP-ckan-uni-UNIM-1920.webp) ## Canadian Watershed Information Network - University of Manitoba CanWIN supports research, education, and policy-making by providing tools to explore and manage data on water quality, climate change, and other environmental issues. [ Go to case study ](https://linkdigital.com.au/case-studies/canadian-watershed-information-network-canwin/) ## Link Digital: your trusted CKAN implementation partner **Over a decade of CKAN expertise dedicated to your success** As one of the few global companies providing end-to-end CKAN services, Link Digital brings unmatched experience to university data challenges. We’re not just implementers; we invest in the wider CKAN community, and are actively supporting and contributing to the platform’s development. ![Transform your university’s data management with CKAN & Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/10/f923f8bc44eea498942d7e0cfc868a5d29c8a8b4-298x200.png) **What makes Link Digital different** **User-centric design We create solutions that align with your institution’s workflows, not generic one-size-fits-all platforms. **Technical excellence Our comprehensive service suite includes: - Custom data workflow development - Dynamic visualization systems - Secured publishing workflows with approval processes - Complex data migration and API integrations - Extensive plugin and extension customization **Holistic approach We understand that successful data projects address more than just technical challenges. Our team considers the human, cultural, legal, and ethical dimensions of large-scale data sharing initiatives. **Proven track record Governments, universities, and not-for-profit organisations worldwide partner with Link Digital to deliver CKAN solutions that drive research innovation and institutional excellence. ## Get your university guide Discover how universities worldwide use CKAN to manage, share, and grow research data. The guide provides practical steps and proven strategies to help you plan and implement your own data portal with confidence. [ Download guide now ](https://linkdigital.com.au/wp-content/uploads/2025/10/A-Guide-to-CKAN-for-Universities_Link-Digital.pdf) ![Transform your university’s data management with CKAN & Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/10/img-preview-pdf-ckan-uni-20251002-031028-1024x1024.webp) ## Ready to transform your data management? Start building the collaborative, insight-driven university of tomorrow. Whether you need an open data portal to showcase your research or an internal platform to improve data management and collaboration, CKAN with Link Digital delivers results. Get started today [ Schedule a consultation ](https://linkdigital.com.au/get-in-touch/) [ View case studies ](https://linkdigital.com.au/case-studies/) ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments Submit --- ### [End-to-end CKAN Services](https://linkdigital.com.au/services/end-to-end-ckan/) **Published:** May 23, 2025 **Author:** Kate Sampher **Excerpt:** Link Digital offers CKAN full professional services from consultancy, migration, support and maintenance, and resources. **Content:** # End-to-end CKAN Services Consultancy, migration, support, maintenance and resources [ Read success stories ](https://linkdigital.com.au/case-studies/) ## Frequently Asked Questions ## CKAN Consultancy What CKAN consultancy services do you offer?​ We provide a full suite of CKAN consultancy services, from initial setup and configuration to long-term management and optimisation. Our team of CKAN experts helps organisations implement CKAN-based data portals, enhance digital transformation, and improve metadata management. We work with you to understand your unique requirements. We work with you to understand your unique requirements. How do you customise CKAN solutions for specific industries?​ Government, business, not-for-profits, and research institutions and universities all have unique data management needs. We focus on aligning CKAN with the specific goals of your organisation, whether it’s improving data quality and accessibility, [DCAT](https://linkdigital.com.au/news/2025/01/dcat-101-unlocking-the-power-of-data-through-standardisation/) or FAIR compliance, or improved internal or external data sharing and collaboration. Our services include data audits for a whole organisation overview of your data needs and capabilities, help with data governance, security, and risk mitigation, and advice to ensure your CKAN solution is configured to support industry-specific standards and workflows. Can you assist with CKAN migrations?​ Yes, we specialise in migrating legacy data management systems to CKAN. Our team helps plan and execute smooth migrations with minimal disruption and data integrity during the process. Whether you’re moving from a proprietary or open-source system, we have the expertise to guide you through every step. [Read case study: IDB data catalogue migration](https://linkdigital.com.au/case-studies/inter-american-development-bank-open-data-catalogue/) ## CKAN Hosting What CKAN hosting services do you provide?​ We offer reliable, flexible cloud hosting services for CKAN open data portals, [internal data management systems,](https://www.youtube.com/watch?v=Xam9GQG-Z2s&list=PLNYR4MdBNnu96YLIWJlvL-KFS_3D5oGy0) and metadata catalogues. We can install CKAN on cloud infrastructure and configure it according to a client’s precise requirements on platforms including Amazon Web Services, Microsoft Azure, Google Cloud, and secure government clouds. We can manage all aspects of your hosting environment, including server maintenance, backups, and performance optimisation, ensuring your data is stored effectively and safely and your CKAN instance always runs smoothly. Is your CKAN hosting scalable?​ Yes, our hosting solutions are designed to scale up or down, responding rapidly and easily to the changing requirements of your organisation. This makes them cost-effective and ensures your CKAN instance can perform to its optimal capacity, even as the data volume, user traffic, and other factors affecting your business or organisation evolve. Do you offer cloud-based CKAN hosting?​ Yes. Our cloud hosting services are based on secure, high-performance platforms like AWS, Google Cloud, and Azure, ensuring flexibility, security, and scalability. We work with you to choose the best hosting environment for your organisation’s needs. [ Download ebook: metadata management ](https://linkdigital.com.au/wp-content/uploads/2025/05/ebook_Modern-Data-Management-_Metadata-catalogue-and-registry-on-CKAN.pdf) ## CKAN Support What types of CKAN support do you offer?​ Our CKAN support includes software upgrades and regular maintenance. Our support packages are designed to ensure your CKAN portal runs smoothly, with fast response times and expert guidance when you need it most. Aside from our experienced support to governments, NGOs and research institutions, Link Digital experts also provide CKAN commercial support to organisations of any size. [Read case study: Columbia Basin Water Hub](https://linkdigital.com.au/case-studies/columbia-basin-water-hub/) How can I contact your CKAN support team?​ You can contact our CKAN support team via email or through our online support [portal (Helpdesk).](https://helpdesk.links.com.au/index.php) Our team is available during business hours and can also provide after-hours support depending on your support package. [ Request for CKAN support pricing ](https://linkdigital.com.au/get-in-touch/) ## CKAN Resources What CKAN resources do you provide?​ We provide a variety of resources to help you get the most out of CKAN, including documentation, tutorials, best practices guides, and case studies. Our resources are designed to empower your team with the knowledge and skills needed to manage and optimise your CKAN data portal and maximise the value of your data across its entire life cycle. Can I access community resources for CKAN?​ The CKAN software is supported by a core development team to keep it in good shape, as well as a large and expanding global user base that includes people drawn from private enterprise, academia, and the community sector. Link Digital is a co-steward of the CKAN project and can provide you with access to this extended user group, as well as a wide range of CKAN community resources, including GitHub repositories – the central storage locations for managing and tracking changes in files and directories – so you can stay updated on the latest developments, new features, and defect correction. Do you provide templates or extensions for CKAN?​ Yes, we offer a variety of CKAN templates and add-ons designed to enhance your data portal’s functionality. Whether you need custom dashboards, enhanced metadata management tools, or specific integrations, we have the resources and expertise to extend CKAN to meet your specific requirements. Link Digital can tailor a comprehensive solution to your organisation’s specific requirements by utilising these extensions. As well as custom dashboards, enhanced metadata management tools, or specific integrations, we have the resources and expertise to extend CKAN to meet your needs. ## Partner with Link Digital ![Questions](https://linkdigital.com.au/wp-content/uploads/2024/10/questions-section-300x177.webp) ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments ## Case studies [ Browse now ](/case-studies) ## See more services [ Explore ](https://linkdigital.com.au/products-services/) --- ### [Secure Data Exchange](https://linkdigital.com.au/services/secure-data-exchange/) **Published:** May 23, 2024 **Author:** Steven De Costa **Excerpt:** A powerful, seamless, flexible, and easy to use approach for data custodians to manage the complete lifecycle of their data across multiple departments, organisational branches, and internal and external data users, in a controlled access environment. **Content:** # Secure Data Exchange Your approach to exchange, categorise and secure your organisation’s data. [ Get in touch ](/get-in-touch) ![Secure data exchange](https://linkdigital.com.au/wp-content/uploads/2024/08/Secure_data_exchange-300x233.webp "Secure data exchange") Secure Data Exchange (SDE) is a powerful, seamless, flexible, and easy to use approach for data custodians to manage the complete lifecycle of their data across multiple departments, organisational branches, and internal and external data users, in a controlled access environment. ## Download guide The data manager’s guide to secure data exchange​ *Please complete the form below to receive your download link.* ### We've encountered an error Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments ![SDE snippet final](https://linkdigital.com.au/wp-content/uploads/2025/02/img-SDE-snippet-final-1-768x384.webp) ## Key features SDE leverages Link Digital’s significant expertise in building data sharing applications with the power and flexibility of the software known as the Comprehensive Knowledge Archive Network (CKAN), to simplify complex data sharing and delivery across large organisations. ### Structured data sharing while keeping flexibility and control SDE enables structured and secure data sharing that allows government departments and other large organisations to retain control of their important data while reaping the benefits of collaboration from its sharing. ![Product concept](https://linkdigital.com.au/wp-content/uploads/2024/08/Product_concept-430x218.webp "Product concept") ### Improve the visibility of who is using your data Data custodians have the right to know what is going on with their data. SDE provides a streamlined, and easy to use and interpret dashboard where they can view all data requests, their status (pending, final approval, ended), and all data sharing agreements. This includes the ability to revoke approval to use data. ![Research & evaluation](https://linkdigital.com.au/wp-content/uploads/2024/08/Research-1-430x218.webp "Research & evaluation") ### Metadata management A customised metadata scheme is incorporated into the workflow of the SDE system. This complies with the criteria set out in the latest [Data Catalog Vocabulary standards,](https://linkdigital.com.au/news/2024/09/what-is-dcat-and-why-is-it-important-for-data-catalogs-and-open-data-portals/) designed to facilitate interoperability between data catalogs. ![Iterative Design & Development](https://linkdigital.com.au/wp-content/uploads/2024/08/Design-and-development-430x218.webp "Iterative Design & Development") ## Receive the latest news from Link Digital [ Subscribe ](https://linkdigital.com.au/newsletter) ### Building trust and accountability The SDE simplifies data sharing and creates explicit approval protocols, allowing data custodians to maintain control and accountability over their data. The streamlined approval procedure builds confidence that data can be shared between departments and clusters, improves transparency in the use of data, and helps foster a culture of trust and mutual accountability around data sharing within organisations. ![Data Practices by Link Digital, the trusted CKAN expert](https://linkdigital.com.au/wp-content/uploads/2024/08/MVP-430x218.webp "Minimal Viable Product (MVP)") ### Clarity around your data delivery SDE allows users to see all their data in one place. This ensures that there is one source of truth for custodian’s data sets, preventing aged or incorrect data from being shared. [Link Digital](https://linkdigital.com.au/) can integrate SDE into a data lake, data stores, etc, so that the data sharing agreement is always pointing to the most up-to-date data in core systems. This all sits behind corporate Identity Access and Management systems, allowing confidence when users are updated on the core security platform. ![Continuous Improvement](https://linkdigital.com.au/wp-content/uploads/2024/08/Continuous-Improvement-430x218.webp "Continuous Improvement") ## Request a demo [ Send request ](/get-in-touch) ## Case studies [ Go to case studies ](/case-studies) ## See other capabilities [ Explore ](/expertise) --- ### [Link Lab](https://linkdigital.com.au/link-lab/) **Published:** January 13, 2026 **Author:** Kate Sampher **Content:** ## Link Lab We don’t just build data portals. We build resilient information systems to support democracy, education, and ethical AI with a clear Statement of Intent. [ Collaborate with Link Lab](#) ![img-link-lab-donut](https://linkdigital.com.au/wp-content/uploads/2026/01/img-link-lab-donut-380x380.png "img-link-lab-donut") ## Let us help you move beyond just storing and sharing data. **It is no longer enough just to make data open and shareable.** AI is changing traditional digital service interfaces, enabling greater public access to the data on your portal, but also making how people interact with it more complex and multifaceted. This presents new challenges, particularly around how to harness AI effectively but ethically. ![](https://linkdigital.com.au/wp-content/uploads/2026/01/img-link-lab-universe-you.png) ## You don't just need a vendor. You need a Lab. A creative partner who can take your idea and collaborate with you to turn it into a working solution. Link Lab combines our deep technical expertise and knowledge of the evolving state of data and digital with the Objective Observer Initiative methodology to help you identify your problem and solve it. ## Every project starts with a Statement of Intent. Before we write a line of code, we work with you to draft a Statement of Intent. This is not just a scope of work. It is a commitment. It defines: **The moral purpose, the constructive goal, the audit trail**. This Statement becomes the compass for the entire project, ensuring we aren’t just building a platform but solving your problem. The moral purpose: Why does this data exist? For example, maybe the purpose is to help a teacher use AI in an effective but ethical way, or to assist a resident to audit the spending of their local government. The constructive goal: What specific outcome are we aiming for? The audit trail: How will we prove, mathematically and socially, that a system is doing what we agreed that it would? ![](https://linkdigital.com.au/wp-content/uploads/2026/01/img-OOISX-moon.png) ## Objective Observer Initiative (OOI) is the foundation ## of our R&D Lab It is where we experiment with the future of how we access data. We use this framework to test new ideas in the following areas: - Ethical AI: Ensuring algorithms are transparent and support human values. - Civic tech: Using open source technology to build digital infrastructure that informs and strengthens organisations and communities. - Knowledge operations: Turning raw data into high quality public interest datasets with teachable moments. ## Do you have a complex data challenge? Let’s treat it like a lab project. You bring the challenge. We bring creativity, technology, and initiative. We work together to come up with a solution. [ Contact the Link Digital Lab ](#) × ### Get in Touch with Link Digital Lab ### We've encountered an error Email: \* Name: \* Organisation: \* Message: \* Subscribe to our newsletter for updates Comments --- ### [Expertise](https://linkdigital.com.au/expertise/) **Published:** June 21, 2017 **Author:** Steven De Costa **Content:** ## Expertise in every stage Successful open data solutions from concept to implementation [ Request for consultation ](/get-in-touch) ![From open data to product implementation - Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/06/img-banner-expertise-380x380.webp "img banner- expertise") **One of our greatest strengths is our globally sourced talent pool.** We have access to experts from around the world, who can bring additional knowledge and skills to your data project. We already have an exceptional team in place with a wealth of skills and expertise to offer. ![CKAN open data portal development and hosting](https://linkdigital.com.au/wp-content/uploads/2025/01/CKAN-expert-Link-Digital-300x200.webp) ## CKAN Our CKAN and open data experts provide managed CKAN hosting, support, extension development and theming to clients globally, and we are recognised as a co-steward of the CKAN Project. [ Read More › ](https://linkdigital.com.au/ckan/) ![WS cloud architecture for data ecosystems](https://linkdigital.com.au/wp-content/uploads/2025/01/AWS-Expert-Link-Digital-300x200.webp) ## Amazon Web Services We provide managed hosting, support and cloud architecture services to the non-profit, Government and education sectors and are recognised via the Public Sector and Open Data partner programs. [ Read More › ](https://linkdigital.com.au/aws/) ![Drupal content management for data portals](https://linkdigital.com.au/wp-content/uploads/2025/01/Drupal-expert-Link-Digital-300x200.webp) ## Drupal We develop digital experiences, services and dashboards with a strong emphasis on supporting content authors and end users. Since 2012, we have leveraged our years of experience in Drupal-based projects. [ Read More › ](https://linkdigital.com.au/drupal/) ## Join hundreds of data portals around the world. ![Questions](https://linkdigital.com.au/wp-content/uploads/2024/10/questions-section-300x177.webp) ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments - [Recent](#recent-posts-tab-2143) - [Popular](#popular-posts-tab-2143) - [Bot traffic and vulnerabilities: How to manage the security aspects of automated visitors](https://linkdigital.com.au/news/2026/09/bot-traffic-and-vulnerabilities-how-to-manage-the-security-aspects-of-automated-visitors/) September 11, 2026 - [CKAN 2.12 is live: Here’s what’s new and why you should upgrade](https://linkdigital.com.au/news/2026/09/ckan-2-12-is-live-heres-whats-new-and-why-you-should-upgrade/) September 3, 2026 - [Introducing Link Digital’s Provenance Sandbox: Changing static storage to active machine learning infrastructure](https://linkdigital.com.au/news/2026/08/introducing-link-digitals-provenance-sandbox-changing-static-storage-to-active-machine-learning-infrastructure/) August 26, 2026 - [Planning a Drupal upgrade in 2026? Here is what you need to know](https://linkdigital.com.au/news/2026/05/planning-a-drupal-upgrade-in-2026-here-is-what-you-need-to-know/) May 6, 2026 902 Views - [What is the future of open data in the AI era?](https://linkdigital.com.au/news/2026/03/what-is-the-future-of-open-data-in-the-ai-era/) March 18, 2026 834 Views - [Making data portals user-friendly: a conversation with a UI/UX expert](https://linkdigital.com.au/news/2026/03/making-data-portals-user-friendly-a-conversation-with-a-ui-ux-expert/) March 17, 2026 691 Views [ Facebook ](https://www.facebook.com/LinkDigital/) [ Youtube ](https://www.youtube.com/@link-digital) [ Linkedin ](https://www.linkedin.com/company/link-digital/) ## About Link Digital *Established in 2002, Link Digital is the trusted partner of governments, NGOs, and enterprise organizations in building data hubs and open data portals.* As developers, implementers, and major contributors to CKAN since 2012, Link Digital provides CKAN hosting, support, and maintenance, as well as consulting and design services. Their team makes data discoverable, searchable, and easy to interpret, helping organizations make sound decisions and solve real-world problems. --- ### [Your ebook is ready!](https://linkdigital.com.au/your-ebook-is-ready/) **Published:** April 10, 2025 **Author:** Kate Sampher **Content:** **Thank you for registering to download our eBook!** We appreciate your interest. You will receive an email shortly with the download link. Please check your inbox (and spam folder just in case). Enjoy reading, and feel free to [reach out](https://linkdigital.com.au/get-in-touch/) if you have any questions! --- ### [Our Partners](https://linkdigital.com.au/partners/) **Published:** February 15, 2018 **Author:** Steven De Costa **Content:** ## Our Partner Network Our mission at Link Digital is to create meaningful change and you can’t do that without putting a little skin in the game. The following partners are those where we contribute in-kind and in some cases financially. The reward to Link Digital is simple. Even if our commercial work is initiated and undertaken with the public good in mind, there is no guarantee that the work couldn’t have been achieved by some other commercial agreement with another party. As a team, we don’t wake up in the morning to spend our time working at ‘just another company’. In the case where we support our community partners, especially in the absence of alternatives for such support, we know that we are adding to the public good and the contribution we make will add to some measure of meaningful change. This is what gets our team moving! [ ![Canadian Open Data Society](https://linkdigital.com.au/wp-content/uploads/2023/12/Logo-CODS.png) ](https://www.opendatasummit.ca/) [ ![CKAN logo](https://linkdigital.com.au/wp-content/uploads/2023/09/CKAN-Association-2-200x200.png) ](https://ckan.org/) [ ![Open Knowledge Australia](https://linkdigital.com.au/wp-content/uploads/2023/09/Open-Knowledge-Australia-2-200x200.png) ](https://okfn.org/en/) [ ![Open Data Institute](https://linkdigital.com.au/wp-content/uploads/2023/12/masterworks-200x200.png) ](https://theodi.org/) [ ![Logo - GovHack](https://linkdigital.com.au/wp-content/uploads/2023/12/Logo-GovHack-200x200.png) ](https://govhack.org/) ## Technology and Innovation There are some amazing technologies and organisations out there. To ensure our solutions are empowered by excellent infrastructure, tooling and supply chain options we invest in trusting relationships and productive collaboration via a select group of partners. [ ![Github](https://linkdigital.com.au/wp-content/uploads/2023/09/Github-1-150x150.png) ](https://linkdigital.com.au/project/github/) ![Azure](https://linkdigital.com.au/wp-content/uploads/2023/12/Azure-150x150.png) [ ![Logo - Drupal](https://linkdigital.com.au/wp-content/uploads/2023/12/Logo-Drupal-150x150.png) ](https://linkdigital.com.au/drupal/) [ ![AWS](https://linkdigital.com.au/wp-content/uploads/2023/09/AWS-2-150x150.png) ](https://linkdigital.com.au/aws/) ## Commercial Partners [ ![Link Digital is Living Lakes Canada's trusted CKAN expert](https://linkdigital.com.au/wp-content/uploads/2023/12/Logo-LLCA-200x200.png) ](https://livinglakescanada.ca/) [ ![Open UK](https://linkdigital.com.au/wp-content/uploads/2023/12/Open-UK-200x200.png) ](https://openuk.uk/) Link Digital’s commercial partner program brings specialist CKAN hosting, support and integration services to clients, supporting enterprise open data solutions upon which governments, corporations and academic institutions rely. Local knowledge and skills are a vital part of successful open data programs. The development of local capability is also an effective way to create meaningful change in an area of work which has a substantial opportunity to create public good. The process for establishing a commercial partnership with Link Digital is simple. - [Get in touch](https://linkdigital.com.au/get-in-touch/) and let us know about the type of work you’d like to do in your region. - Sign our Mutual Non Disclosure Agreement (MNDA) which covers the partnership discussion process. - Together we work through any partnership conditions in a Memorandum of Understanding (MoU). - With the MoU in place we then work together in good faith to identify, mature and secure new opportunities. - When securing the first partnership sale we form a Project Collaboration Agreement - Upon contracting the first sale, the partnership is formalised as per the MoU and you are issued your Certificate of Partnership.Link Digital’s commercial partner program brings specialist CKAN hosting, support and integration services to clients, supporting enterprise open data solutions upon which governments, corporations and academic institutions rely. --- ### [You are now registered!](https://linkdigital.com.au/you-are-now-registered/) **Published:** February 1, 2024 **Author:** Kate Sampher **Content:** ### To ensure you receive all our emails, please add @linkdigital.com.au to your email’s whitelist. --- ### [Resources](https://linkdigital.com.au/resources/) **Published:** April 30, 2024 **Author:** Kate Sampher **Content:** No posts found. --- ### [Product Development](https://linkdigital.com.au/services/product-development/) **Published:** July 20, 2017 **Author:** Steven De Costa **Content:** ## Product development Your great product starts right here [ Talk to an expert ](/get-in-touch) ![Product development](https://linkdigital.com.au/wp-content/uploads/2024/08/Product_development-350x272.webp "Product development") For 20 years, Link Digital has developed solid expertise in building custom, built-to-specification online applications based on CKAN and Drupal. Applying Infrastructure as a Code (IaC) approach allows our DevOps team to efficiently manage applications even with the most sophisticated infrastructure code. Our customers include government, commercial, and non-profit organisations. ## Our approach At Link Digital we strive for mastery in the work we do for both our clients and ourselves. The projects we undertake, and managed services we provide, are envisioned from first principles and brought together from concept to reality through a process very much aligned with product development. #### Product Concept Concepts emerge from the experience and context found in both the tools we use and the use cases to which they are applied. Internal products are born from our own concepts while external client products emerge from needs analysis and ideation. ![Product concept](https://linkdigital.com.au/wp-content/uploads/2024/08/Product_concept-430x218.webp "Product concept") #### Research Concepts are tested and refined against knowledge and insight gained through research. Our Product Owner’s accumulate as much general and specific information about the applied utility to form a theoretical understanding of where value can be obtained and maximised. ![Research & evaluation](https://linkdigital.com.au/wp-content/uploads/2024/08/Research-1-430x218.webp "Research & evaluation") ## Ready to create your next product? [ Get in touch ](/get-in-touch) #### Iterative Design & Development Ideas are tested early and often via proofs of concept which guide further improvement and competitively test competing approaches. Leading toward a cohesive solution architecture and user centred design. ![Iterative Design & Development](https://linkdigital.com.au/wp-content/uploads/2024/08/Design-and-development-430x218.webp "Iterative Design & Development") #### Minimal Viable Product (MVP) Ideas are tested early and often via proofs of concept which guide further improvement and competitively test competing approaches. Leading toward a cohesive solution architecture and user centred design. ![Data Practices by Link Digital, the trusted CKAN expert](https://linkdigital.com.au/wp-content/uploads/2024/08/MVP-430x218.webp "Minimal Viable Product (MVP)") #### Continuous Improvement Products are concurrently managed to ensure operational consistency and quality while also undergoing improvement. Change management is integrated with release cycles to ensure users and operational staff are informed and empowered by both functional and non functional improvements. ![Continuous Improvement](https://linkdigital.com.au/wp-content/uploads/2024/08/Continuous-Improvement-430x218.webp "Continuous Improvement") ## Ready to connect? [ Talk to us ](/get-in-touch) ## Browse cases [ More details ](/case-studies) ## See other capabilities [ More details ](/expertise) --- ### [Secure AWS architecture](https://linkdigital.com.au/secure-aws-architecture/) **Published:** December 29, 2017 **Author:** Steven De Costa **Content:** ## We handle the complexity so you can focus on the insights. Getting the most out of your data depends entirely on the platform it lives on. You need something that’s not only powerful but also reliable, future-proof, and ready to grow with your goals. That’s precisely what this diagram represents: the blueprint for your data environment. ![aws architecture](https://linkdigital.com.au/wp-content/uploads/2025/06/aws-architecture-768x968.png) AWS Architecture - Link Digital ## Let’s break down what this architecture delivers for you, in simple terms: ### **1. Your data’s private home in the cloud** **What it is:** Imagine us building a customised home for your data within the Amazon Web Services (AWS) Cloud. It’s a private network that is completely isolated from other AWS traffic. **What it means for you:** Your CKAN portal is hosted in its own private network which is accessible only via the public HTTPS endpoints that CKAN provides. ### **2. Always on, always ready** **What it is:** If there’s high traffic to your portal, it can automatically scale up to handle the demand without user intervention. Likewise, when that traffic reduces, our hosting will scale down to default resources automatically. **What it means for you:** No more worrying about your data portal crashing during peak times or going offline for extended periods. Your users will always have a smooth, fast experience, and you can trust that your platform will stay resilient and functional. ### **3. Highly available data storage** **What it is:** Link Digital uses PostgreSQL, an industry-leading open source database technology, in addition to multiple layers of reliable storage solutions. Your primary data is stored securely and backed up automatically. **What it means for you:** Your valuable data is not just stored, it’s *protected*. With automatic backups and disaster recovery capabilities, you have peace of mind knowing your information is safe from accidental deletion or hardware failures. Your data integrity is our top priority. ### **4. Effortless scalability & performance** **What it is:** Every part of our architecture, from web servers to database servers, is designed to grow. As your data volume increases or your user base expands, the system can expand with it without requiring major reconfigurations. **What it means for you:** You get a future-proof solution. Whether you have a small amount of data today or a massive amount tomorrow, your platform will perform consistently and efficiently, supporting your long-term growth without bottlenecks or complications. ### **5. Managed security & expertise** **What it is:** This complex diagram shows the power of AWS, but you don’t need to be an AWS expert to harness it. Link Digital can manage all of this for you. Our global team of professionals continuously monitors your environment to ensure uptime, stability and security. **What it means for you:** You benefit from enterprise-grade security and reliability without the overhead of managing a complex IT infrastructure. We handle the heavy lifting. This allows you to focus on your core business and leveraging the benefits of your data, rather than worrying about the underlying technology. ## Request a demo [ Send request ](/get-in-touch) ## Case studies [ Explore ](/case-studies) ## Other services [ Explore ](/expertise) [ Facebook ](https://www.facebook.com/LinkDigital/) [ Youtube ](https://www.youtube.com/@link-digital) [ Linkedin ](https://www.linkedin.com/company/link-digital/) ## About Link Digital *Established in 2002, Link Digital is a trusted partner of governments, NGOs, and enterprise organizations in building data hubs and open data portals.* As developers, implementers, and major contributors to CKAN since 2012, Link Digital provides CKAN hosting, support, and maintenance, as well as consulting and design services. Their team makes data discoverable, searchable, and easy to interpret, helping organizations make sound decisions and solve real-world problems. --- ### [CKAN Architecture](https://linkdigital.com.au/ckan-architecture/) **Published:** December 29, 2017 **Author:** Steven De Costa **Content:** ![CKAN Architecture - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/10/CKAN-Architecture-e1730359076456-1024x1024.png) ## About the diagram This CKAN deployment architecture is designed for high availability, scalability, and resilience within a secure Virtual Private Cloud (VPC) environment. An Elastic Load Balancer (ELB) with a public facing interface manages incoming HTTP/S traffic by distributing requests among various CKAN Core instances. These instances, configured within a Web Auto Scaling Group, adjust dynamically based on demand, providing seamless scalability. Data is managed through a primary PostgreSQL database with read-replica slaves, allowing optimized read performance and high availability. For advanced search capabilities, the architecture integrates Solr, an indexing service, with its own Auto Scaling Group, ensuring efficient handling of search queries. Network File System (NFS) instances provide shared storage for CKAN and Solr. These instances are backed by Elastic Block Store (EBS) volumes and kept safe by regular snapshots to Amazon S3. This makes data more resilient and easier to recover from disasters. This architecture also emphasizes network security, with components isolated in VPC subnets and communication restricted to internal connections. The overall setup is designed to deliver a powerful, scalable, and secure CKAN solution, ideal for demanding data management needs in the cloud. [ Publish your data easily with CKAN › ](https://linkdigital.com.au/ckan-and-open-data/) --- ### [Application Development](https://linkdigital.com.au/services/application-development/) **Published:** July 20, 2017 **Author:** Steven De Costa **Content:** ## Application Development We bring your ideas to life [ Get in touch ](/get-in-touch) ![Data Practices - Link Digital, CKAN expert](https://linkdigital.com.au/wp-content/uploads/2024/08/banner_application_development-568x442.webp "Banner Application Development") ## Why work with Link Digital Over a decade, Link Digital has developed a solid expertise in building custom, built-to-specification online applications based on CKAN and Drupal. Applying Infrastructure as a Code (IaC) approach allows our DevOps team to efficiently manage applications even with the most sophisticated infrastructure code. Our customers include government, commercial and non-profit organisations. ## Our approach ### At Link Digital, we are huge fans of Agile. Not only it facilitates collaboration between our team members but also allows our clients to play an active role in the development cycle. For project work, we employ the Scrum methodology, which provides a standard and proven framework for managing the types of processes needed to successfully establish technical projects. ### Research & evaluation First and foremost, we arrange meetings in order to determine the project requirements. This is where the “Who”, “What”, and “Why” questions are raised. ![Research & evaluation](https://linkdigital.com.au/wp-content/uploads/2024/08/Research-1-430x218.webp "Research & evaluation") ### Planning & prioritisation Following scrum methodology, we create a backlog of user stories, estimate, set priorities and divide the project into sprints. Our sprints run on a weekly cycle. ![Planning & prioritisation](https://linkdigital.com.au/wp-content/uploads/2024/08/Planning-1-430x218.webp "Planning & prioritisation") #### Development This is the stage when the actual coding and design are started, and the Dev & UAT environments are set up. Throughout the duration of the project, our Product Owners make sure regular meetings are scheduled to give the client an opportunity to review our progress and update the priorities. ![Development](https://linkdigital.com.au/wp-content/uploads/2024/08/Development-1-430x218.webp "Development") ### Release & support After successful validation, the project is deployed to the Production environment and transitioned to support where further enhancements can be implemented. ![Release & support](https://linkdigital.com.au/wp-content/uploads/2024/08/Release-1-430x218.webp "Release & support") ## Request a demo [ Send request ](/get-in-touch) ## Browse cases [ More details ](/case-studies) ## See other capabilities [ More details ](/expertise) --- ### [Drupal](https://linkdigital.com.au/drupal/) **Published:** June 21, 2017 **Author:** Steven De Costa **Content:** ## Drupal The most powerful open source content management software [ Talk to an expert ](/get-in-touch) ![DRUPAL EXPERTISE - LINK DIGITAL](https://linkdigital.com.au/wp-content/uploads/2024/08/drupal-350x272.webp "drupal") ## Our approach ### At Link Digital, we are huge fans of Agile. Not only it facilitates collaboration between our team members but also allows our clients to play an active role in the development cycle. For project work, we employ the Scrum methodology, which provides a standard and proven framework for managing the types of processes needed to successfully establish technical projects. #### Research & evaluation First and foremost, we arrange meetings in order to determine the project requirements. This is where the “Who”, “What”, and “Why” questions are raised. ![Research & evaluation](https://linkdigital.com.au/wp-content/uploads/2024/08/Research-1-430x218.webp "Research & evaluation") #### Planning & prioritisation Following scrum methodology, we create a backlog of user stories, estimate, set priorities and divide the project into sprints. Our sprints run on a weekly cycle. ![Planning & prioritisation](https://linkdigital.com.au/wp-content/uploads/2024/08/Planning-1-430x218.webp "Planning & prioritisation") #### Development This is the stage when the actual coding and design are started, and the Dev & UAT environments are set up. Throughout the duration of the project, our Product Owners make sure regular meetings are scheduled to give the client an opportunity to review our progress and update the priorities. ![Development](https://linkdigital.com.au/wp-content/uploads/2024/08/Development-1-430x218.webp "Development") #### Release & support After successful validation, the project is deployed to the Production environment and transitioned to support where further enhancements can be implemented. ![Release & support](https://linkdigital.com.au/wp-content/uploads/2024/08/Release-1-430x218.webp "Release & support") ## Sites built with Drupal by Link Digital [ ![Pacific Data Hub](https://linkdigital.com.au/wp-content/uploads/2025/05/img-PDH-mockups-269x200.webp) ](https://linkdigital.com.au/project/pacific-data-hub/) ### Pacific Data Hub [ View case study ](https://linkdigital.com.au/project/pacific-data-hub/) [ ![Canadian Watershed Information Network - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/07/CanWIN-Cover-300x200.jpg) ](https://linkdigital.com.au/project/canadian-watershed-information-network-canwin/) ### Canadian Watershed Information Network [ View case study ](https://linkdigital.com.au/project/canadian-watershed-information-network-canwin/#) [ ![NSW Multiple SEED Portal - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/11/Image-NSW-SEED-The-Central-Resource-for-Sharing-and-Enabling-Environmental-Data-in-NSW-768x402.jpg) ](https://linkdigital.com.au/project/sharing-and-enabling-environment-data-seed-portal/) ### New South Wales SEED Portal [ View case study ](https://linkdigital.com.au/project/sharing-and-enabling-environment-data-seed-portal/#) [ ![VESR- drupal based site - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/08/www.vesr_.gov_.au_browse-1-300x200.png) ](https://linkdigital.com.au/project/columbia-basin-water-hub/) ### Vehicle Emission Star Rating Website [ View case study ](https://linkdigital.com.au/project/vehicle-emission-star-rating/) ## Request a demo [ Send request ](/get-in-touch) ## Case studies [ Explore ](/case-studies) ## More services [ Explore ](/expertise) [ Facebook ](https://www.facebook.com/LinkDigital/) [ Youtube ](https://www.youtube.com/@link-digital) [ Linkedin ](https://www.linkedin.com/company/link-digital/) ## About Link Digital *Established in 2002, Link Digital is a trusted partner of governments, NGOs, and enterprise organizations in building data hubs and open data portals.* As developers, implementers, and major contributors to CKAN since 2012, Link Digital provides CKAN hosting, support, and maintenance, as well as consulting and design services. Their team makes data discoverable, searchable, and easy to interpret, helping organizations make sound decisions and solve real-world problems. --- ### [AWS](https://linkdigital.com.au/aws/) **Published:** June 21, 2017 **Author:** Steven De Costa **Content:** ## Amazon Web Services Reliable, scalable, and inexpensive cloud computing services [ Get in touch ](/get-in-touch) ![AWS](https://linkdigital.com.au/wp-content/uploads/2025/10/web-amazon-450x290.png "web amazon") ## CKAN 2.11 pre-configured by Link Digital A pre-configured, ready-to-run image for running CKAN on Amazon EC2. The image includes several CKAN pre-installed extensions, including “harvest” and “pages.”. [ Go to AWS Marketplace listing ](https://aws.amazon.com/marketplace/pp/prodview-q7axjeawoutck?sr=0-3&ref_=beagle&applicationId=AWSMPContessa) ![AWS](https://linkdigital.com.au/wp-content/uploads/2025/10/CKAN-e1760676740208-1024x475.png) ## Our approach ### At Link Digital, we are huge fans of Agile. Not only does it facilitate collaboration between our team members but it also allows our clients to play an active role in the development cycle. For project work, we employ the Scrum methodology, which provides a standard and proven framework for managing the types of processes needed to successfully establish technical projects. ![Development](https://linkdigital.com.au/wp-content/uploads/2024/08/Development-1-430x218.webp "Development") #### **Research & evaluation​** First and foremost, we arrange meetings in order to determine the project requirements. This is where the “Who”, “What”, and “Why” questions are raised. #### **Planning & prioritisation** Following scrum methodology, we create a backlog of user stories, estimate, set priorities and divide the project into sprints. Our sprints run on a weekly cycle. #### **Development​** This is the stage when the actual coding and design are started, and the Dev & UAT environments are set up. Throughout the duration of the project, our Product Owners make sure regular meetings are scheduled to give the client an opportunity to review our progress and update the priorities. #### **Release & support​** After successful validation, the project is deployed to the Production environment and transitioned to support where further enhancements can be implemented. ## Request a demo [ Send request ](/get-in-touch) ## Case studies [ Go to case studies ](/case-studies) ## See other capabilities [ Explore ](/expertise) --- ### [Terms and Conditions](https://linkdigital.com.au/terms-and-conditions/) **Published:** July 25, 2017 **Author:** Steven De Costa **Content:** # **TERMS AND CONDITIONS** ### **1. TERMS** 1.1 Terms: These terms and conditions (**Terms**) apply to our Customer’s use of our Services and complement any Customer contract with Link Web Services Pty Ltd (trading as ‘Link Digital’). In the event of any inconsistency between these Terms and individual Customer contracts, the Terms will apply but only to the extent of the inconsistency. 1.2 Compliance: The use of our Services is conditional upon the acceptance and compliance with these Terms, our Acceptable Use Policy and Privacy Policy. ### **2. QUOTES AND ORDERS** 2.1 Expiry: Quotes are valid for a period of 30 days. Link Digital reserves the right to reissue, vary or withdraw a Quote for which the Quote is not approved by the Customer in writing within 30 days of issue. 2.2 Payment terms: All Link Digital invoices are payable within 14 days of issue, except as otherwise specified in writing by Link Digital. 2.3 Not binding: Any Quote is an invitation to place an Order for the provision of Services by Link Digital and does not give rise to a binding contract between the parties. 2.4 Acceptance: All Quotes must be accepted in writing and Link Digital will not accept or be bound by any quote or purchase order made or accepted verbally. By accepting a Quote, the Customer is deemed to have accepted these Terms. 2.5 Specifications: Orders are based on information and specifications detailed within the relevant Quote (**Specifications**). If the Specifications are changed, or if further services are required which is not itemised or defined, Link Digital reserves the right to provide an additional Quote for this work based on our standard rates at that time (ex GST). 2.6 Project Timeline: On acceptance of a Quote, Link Digital provides the Customer with a Project Timeline and Payment Schedule which may include a project engagement fee. In the event the Project Timeline is delayed as a result of any matter arising out of the Customer’s act or omission for a period of more than one month or in the event the Order is cancelled at any time, Link Digital reserves the right to invoice the Customer for work completed up until the date of the cancellation. In this case, Link Digital will not be considered to be the party at fault and reserves the right to vary the Project Timeline or send a project variation (acting reasonably) without any penalty or charge. 2.7 Variations: As work progresses, reasonable, yet unforeseen Customer and/or vendor corrections, amendments and changes (**Variations**) may be required. In the event that such Variations are outside of the scope of Services provided for within the current and prevailing Quote, additional charges may be incurred. At which point, Link Digital will advise the Customer of any additional charges for Variations and will provide another Quote based on hourly rates, prior to proceeding with implementing the Variations. ### **3. DELIVERY AND PROJECT TIMELINES** (a) Delivery dates within a Project Timeline are estimated and indicatively only and are based on information provided to Link Digital as at the date of Quote. (b) The Customer acknowledges that the Project Timeline relies on both Link Digital and the Customer meeting each of the proposed milestones. In the event, a Customer is unable to meet the requirements of a milestone, the Customer agreed that the Project Timeline may need to be revised subject to Link Digital’s existing studio workload and scheduling. (c) Under no circumstances will Link Digital be liable for loss or damages for failure to deliver by the date specified Quote including, but not limited to, loss or damage suffered by the Customer. (d) If delivery is in instalments or milestone, delay in delivery of any instalment or milestone does not relieve the Customer of its obligation to accept the remaining instalments or milestones in the Order. ### **4. SPECIFICATIONS** (a) Any Quote issued by Link Digital is based only on information or specifications received from the Customer and in Link Digital’s possession as at time of Quote. (b) Unless otherwise agreed with a Customer, Link Digital does not warrant or make any representation that the Services will comply with any technical, regulatory or other specifications or standards provided by the Customer including quality, function performance or design. (c) Technical or other specifications or standards provided by the Customer do not merge with and/or form part of any contract between the Customer and Link Digital for the purchase of Products by the Customer from Link Digital. (d) For the avoidance of doubt, Link Digital will not be responsible for any loss or damage suffered by the Customer in connection with specifications the Customer has provided including, but not limited to, loss or damage suffered in connection with the provision of the wrong specifications, superseded pecifications or items not included in the specifications. (e) In the event that the Customer has exceeded the approved limit applying to the Customer’s credit facility with Link Digital or failed to meet payment obligations under an Order, Link Digital may immediately cease delivering the Services until the Customer’s account is within the approved limit and/or all outstanding invoices have been paid in full. Link Digital also reserves the right to charge interest to the Customer of \[8%\] on any overdue amounts that are not paid within 14 days of the date of invoice. 4.2 Implementation: In the case that a client does not provide detailed instructions to Link Digital on how to implement a required functionality of a Project, Link Digital reserves the right to implement this functionality at our own discretion based on our professional expertise. The Customer is obliged to accept any such work that does not contradict their written requirements as they were provided to Link Digital before entering into an Order. 4.3 New technology: Link Digital is not responsible for an y problems, errors or issues regarding functionality caused as a result of releases of newer technology being released after a Project has been accepted. Any technical issues including but not limited to compatibility or integration that require further work that may be required as a result may be quoted for separately based on our standard hourly rates at that time (ex GST). 4.4 Warranty: Link Digital will fix all Severity 1 and Severity 2 bugs and discrepancies (excluding any issues due to newer technology being released) notified by the Customer. It is the Customer’s responsibility to notify Link Digital of any bugs/discrepancies within a 30-day period from a milestone deployment. If any bugs/discrepancies are found outside of the 30 day period they are not covered by warranty and will require an additional quote to fix. 4.5 Browsers: Unless specified, Link Digital will use reasonable and current best-practice measures for cross-browser testing across browsers and devices. Link Digital reserves the right to provide an additional Quote for any specific browser testing requirements required by a Customer. 4.6 Content: Customer acknowledges that Quotes are based on the assumption that all Customer supplied content (including all data, text, graphics, logos, audio and software) (Content) are final versions and any changes or replacement to these after they have been provided may be considered scope Variations and may be subject to further charges by Link Digital. 4.7 Costs: Costs provided do not generally, unless otherwise specified in a Quote, include fees associated with licensing, sourcing or purchasing of Content, third-party software, domain registration or hosting that may be required. Images can be sourced as positionals if required by a Customer at additional charge. In such cases, a separate Quote for purchase will be provided by Link Digital. ### **5. PRODUCTION ENVIRONMENT HOSTING CHARGES** 5.1 Where applicable Link Digital will provide explanations and costings for one or more proposed infrastructure hosting environments suitable to meet the needs of a Customer’s website (Website). Unless otherwise stated in our proposal or Quote, Link will provide a service summary before your website is due to go live as confirmation of the service level agreement attached to the hosting option selected. ### **6. DEVELOPMENT CYCLE HOSTING CHARGES** 6.1 Link utilises modern cloud infrastructure and integrated development practices for all of our projects. We reserve the right to pass on all reasonable costs of this infrastructure to clients during the development period. ### **7. ADVISING ON ISSUES** 7.1 Link adopts agile work practices within our development studio, yet remains fixed on delivery against documented requirements with our clients. During development cycles we expect that our clients exercise an active role in the resolution of issues by providing information promptly and confirming the resolution of issues as appropriate, without delay. ### **8. ADDITIONAL TERMS AND CONDITIONS** (a) Where applicable customers must also abide by the terms of third-party cloud or software service providers. (b) Service inclusions are only those as outlined by a Quote or our standard Service Level Agreement or as explicitly outlined as being in addition to our standard Service Level Agreement. (c) Software or Server updates will not be performed by Link Digital unless specified in a Service Level Agreement. Link Digital can be engaged to perform updates (including backups). To mitigate any potential problems, a backup of the Website prior to every update is recommended. # ACCEPTABLE USE POLICY ### ACCEPTABLE USE POLICY (AUP) 8.2 We impose additional restrictions on the use of our services to ensure that our services operate fairly for all customers and to safeguard our name, goodwill and reputation. This AUP stipulates constraints and practices that apply to anyone who uses the services of Link Digital, including web hosting. Agreement to this AUP is a condition of Link Digital providing any services. Included in this AUP are some likely consequences of non-compliance. These range from warning users to disabling user accounts. As an extreme measure, legal action may be sought. ### **9. PROHIBITIONS** 9.1 The prohibitions in this AUP are in addition to and not instead of those contained in any specific or unique customer contract. (a) Our services must not be used to: (i) abuse, menace, harass, intimidate or stalk anyone; (ii) break the law or allow another person to break the law (includes Commonwealth, State or Territory Laws or any other jurisdiction); (iii) enable you to act in a way that would place Link Digital in breach of any applicable law, including those that regulate the provision of internet and telecommunications-related services (iv) damage property including intellectual property; (v) facilitate the commission of a offense, or breach of contract; (vi) misuse or allow for the misuse of anyone’s personal information, confidential or sensitive information or health information, as defined by the Privacy Act 1988; (vii) deceive, access or manipulate (or allow anyone else to) any part of our network; (viii) interfere with someone else’s computer without their permission; (ix) upload, send or distribute any virus, worm, trojan or other malicious code including any file that may cause damage to the property of Link Digital or the property any other individuals; (x) upload, send, alter or create an electronic message (including spoofing) to conceal the true identity of the person from whom it originates; (xi) use a remote system (such as a mail server or proxy server), without the authorisation of the owner of it, for the transmission of data; (xii) engage in any misleading or deceptive business or marketing practice; (xiii) involves providing or promoting illegal pyramid selling schemes or unlawful gambling or gaming activities; (xiv) send, display or publish material which: (A) is illegal; (B) is obscene or offensive; (C) is defamatory or potentially defamatory; (D) would contravene anyone’s intellectual property rights; (E) is likely to incite sexual, religious or racial hatred, violence, discrimination or vilification. ### **10. SPAM** 10.1 Facilitating or engaging in any act or omission which is in contravention of the Spam Laws is not allowed. This includes: (a) unsolicited bulk or commercial messages (“spam”). This includes, but is not limited to, bulk mailing of commercial advertising, informational announcements, charity requests, petitions for signatures, and political or religious tracts. Such messages may only be sent to those who have explicitly requested it from your domain. (b) forging, altering or removing electronic mail headers is prohibited. Any domain sending stealth spam will be terminated without warning and without refund. (c) sending numerous copies of the same or substantially similar message with the intent to disrupt a server or account (“mail bombing”). (d) mail may not be used to harass or intimidate others. Harassment, whether through language, frequency of messages, or size of messages, is prohibited. Sending a single unwelcome message may be considered harassment. If a recipient asks to stop receiving e-mail, you must not send that person any further messages. (e) providing spamware (software used to send bulk email or software used to harvest email addresses) or links to sites providing spamware is strictly prohibited and subject to demand for removal or account cancellation. ### **11. BREACHES AND OUR RIGHTS TO SUSPEND OR TERMINATE THE SERVICE** 11.1 In addition to our other rights of suspension, we may suspend our provision of Service to you in the following events: (a) if the Service provided to you is being used to host any device or service that allows email to be sent between third parties not under your authority and control; or (b) if you are in breach of the conditions set out above; provided however that we will first make reasonable attempts to contact you and give you the opportunity to address the problem within a reasonable time period. What is reasonable in this context will depend on the severity of the problems being caused by the open service of breach referred to above. 11.2 Customers are to mitigate risk of breach by endeavouring to secure any device or network within your control against being used in breach as described above by third parties. Such risk mitigation may include where appropriate: (a) the installation and maintenance of antivirus software; (b) the installation and maintenance of firewall software; and (c) the application of operating system and application software and patches and updates. 11.3 Our right to suspend your account applies regardless of whether the open service is provided or the breach is committed intentionally, through misconfiguration, or by other means not authorized by you including but not limited to through a Trojan horse or virus. 11.4 We may scan any IP address ranges allocated to a customer for their use with the Service in order to detect the presence of open or otherwise misconfigured services. 11.5 If the Service is suspended and the grounds upon which it was suspended are not corrected by the client within 7 days, we may terminate the Service. If the Service is terminated under this clause, customers may apply for a pro-rata refund of any pre-paid charges for the Service, but we have the right to levy a reasonable fee for any costs incurred as a result of the conduct that resulted in the suspension. 11.6 To the extent permitted by law, we reserve the right to decide whether any action or omission constitutes unacceptable use and our decision will be final. # **PRIVACY POLICY** ### **1. PRIVACY POLICY** 1.1 In this Privacy Policy, ‘us’ ‘we’ or ‘our’ means Link Web Services Pty Ltd trading as Link Digital ACN 100 170 625. We are committed to respecting your privacy. Our Privacy Policy sets out how we collect, use, store and disclose your personal information. 1.2 By providing personal information to us, you consent to our collection, use and disclosure of your personal information in accordance with this Privacy Policy and any other arrangements that apply between us. We may change our Privacy Policy from time to time by publishing changes to it on our website. We encourage you to check our website periodically to ensure that you are aware of our current Privacy Policy. 1.3 Personal information includes information or an opinion about an individual that is reasonably identifiable. For example, this may include your name, age, gender, postcode and contact details. ### **2. WHAT PERSONAL INFORMATION DO WE COLLECT?** 2.1 We may collect the following types of personal information: (a) name; (b) mailing or street address; (c) email address; (d) and other contact details; (e) your device ID, device type, geo-location information, computer and connection information, statistics on page views, traffic to and from the sites, ad data, IP address and standard web log information; (f) details of the services we have provided to you or that you have enquired about, including any additional information necessary to deliver those products and services and respond to your enquiries; (g) any additional information relating to you that you provide to us directly through our website or indirectly through your use of our website or online presence or through other websites or accounts from which you permit us to collect information; (h) information you provide to us through customer surveys; o (i) any other personal information that may be required in order to facilitate your dealings with us. ### **3. HOW DO WE COLLECT PERSONAL INFORMATION?** 3.1 We may collect these types of personal information either directly from you, or from third parties. We may collect this information when you: (a) register on our website; (b) communicate with us through correspondence, chats, email, or when you share information with us from other social applications, services or websites; (c) interact with our sites, services, content and advertising; or (d) invest in our business or enquire as to a potential purchase in our business. 3.2 In addition, when you apply for a job or position with us we may collect certain information from you (including your name, contact details, working history and relevant records checks) from any recruitment consultant, your previous employers and others who may be able to provide information to us to assist in our decision on whether or not to make you an offer of employment or engage you under a contract. This Privacy Policy does not apply to acts and practices in relation to employee records of our current and former employees, which are exempt from the Privacy Act. ### **4. WHY DO WE COLLECT, USE AND DISCLOSE PERSONAL INFORMATION?** 4.1 We may collect, hold, use and disclose your personal information for the following purposes: (a) to enable you to access and use our website; (b) to operate, protect, improve and optimise our website, business and our users’ experience, such as to perform analytics, conduct research and for advertising and marketing; (c) to send you service, support and administrative messages, reminders, technical notices, updates, security alerts, and information requested by you; (d) to send you marketing and promotional messages and other information that may be of interest to you, including information sent by, or on behalf of, our business partners that we think you may find interesting; (e) to comply with our legal obligations, resolve any disputes that we may have with any of our users, and enforce our agreements with third parties; and (f) to consider your employment application. 4.2 We may also disclose your personal information to a trusted third party who also holds other information about you. This third party may combine that information in order to enable it and us to develop anonymised consumer insights so that we can better understand your preferences and interests, personalise your experience and enhance the products and services that you receive. ### **5. DO WE USE YOUR PERSONAL INFORMATION FOR DIRECT MARKETING?** 5.1 We and/or our carefully selected business partners may send you direct marketing communications and information about our service. This may take the form of emails, SMS, mail or other forms of communication, in accordance with the Spam Act and the Privacy Act. You may opt-out of receiving marketing materials from us by contacting us using the details set out below or by using the opt-out facilities provided (e.g. an unsubscribe link). ### **6. TO WHOM DO WE DISCLOSE YOUR PERSONAL INFORMATION?** 6.1 We may disclose personal information for the purposes described in this privacy policy to: (a) our employees and related bodies corporate; (b) third party suppliers and service providers (including providers for the operation of our websites and/or our business or in connection with providing our products and services to you); (c) professional advisers, dealers and agents; (d) payment systems operators (eg merchants receiving card payments); (e) our existing or potential agents, business partners or partners; (f) anyone to whom our assets or businesses (or any part of them) are transferred; (g) specific third parties authorised by you to receive information held by us; and/or (h) other persons, including government agencies, regulatory bodies and law enforcement agencies, or as required, authorised or permitted by law. ### **7. USING OUR WEBSITE AND COOKIES** 7.1 We may collect personal information about you when you use and access our website. 7.2 While we do not use browsing information to identify you personally, we may record certain information about your use of our website, such as which pages you visit, the time and date of your visit and the internet protocol address assigned to your computer. 7.3 We may also use ‘cookies’ or other similar tracking technologies on our website that help us track your website usage and remember your preferences. Cookies are small files that store information on your computer, TV, mobile phone or other device. They enable the entity that put the cookie on your device to recognise you across different websites, services, devices and/or browsing sessions. You can disable cookies through your internet browser but our websites may not work as intended for you if you do so. 7.4 We may also use cookies to enable us to collect data that may include personal information. For example, where a cookie is linked to your account, it will be considered personal information under the Privacy Act. We will handle any personal information collected by cookies in the same way that we handle all other personal information as described in this Privacy Policy. ### **8. SECURITY** 8.1 We may hold your personal information in either electronic or hard copy form. We take reasonable steps to protect your personal information from misuse, interference and loss, as well as unauthorised access, modification or disclosure and we use a number of physical, administrative, personnel and technical measures to protect your personal information. However, we cannot guarantee the security of your personal information. ### **9. LINKS** 9.1 Our website may contain links to websites operated by third parties. Those links are provided for convenience and may not remain current or be maintained. Unless expressly stated otherwise, we are not responsible for the privacy practices of, or any content on, those linked websites, and have no control over or rights in those linked websites. The privacy policies that apply to those other websites may differ substantially from our Privacy Policy, so we encourage individuals to read them before using those websites. ### **10. ACCESSING OR CORRECTING YOUR PERSONAL INFORMATION** 10.1 You can access the personal information we hold about you by contacting us using the contact us function. Sometimes, we may not be able to provide you with access to all of your personal information and, where this is the case, we will tell you why. We may also need to verify your identity when you request your personal information. 10.2 If you think that any personal information we hold about you is inaccurate, please contact us and we will take reasonable steps to ensure that it is corrected. ### **11. MAKING A COMPLAINT** 11.1 If you think we have breached the Privacy Act, or you wish to make a complaint about the way we have handled your personal information, you can contact us at . Please include your name, email address and/or telephone number and clearly describe your complaint. We will acknowledge your complaint and respond to you regarding your complaint within a reasonable period of time. If you think that we have failed to resolve the complaint satisfactorily, we will provide you with information about the further steps you can take. ### **12. CONTACT US** 12.1 For further information about our Privacy Policy or practices, or to access or correct your personal information, or make a complaint, please contact us at . ***Effective:** 10 January 2023* --- ### [Download: Secure Data Exchange](https://linkdigital.com.au/download-secure-data-exchange/) **Published:** February 23, 2025 **Author:** Kate Sampher **Content:** # [Link Digital’s Secure Data Exchange](https://linkdigital.com.au/wp-content/uploads/2025/02/ebook-Secure-data-exchange.pdf) # [A data manager’s guide](https://linkdigital.com.au/wp-content/uploads/2025/02/ebook-Secure-data-exchange.pdf) # [← Back to main page](https://linkdigital.com.au/) --- ### [Continue the conversation with MLCommons](https://linkdigital.com.au/fair-ai-data/) **Published:** October 14, 2025 **Author:** Kate Sampher **Excerpt:** Interested in FAIR, AI-ready Data? Continue the Conversation with MLCommons. You're Invited: Join Our Next Working Group Meeting **Content:** An Invitation for my Fellow IDW2025 Attendees ![](https://linkdigital.com.au/wp-content/uploads/2024/10/ckan-logo-1.webp) ### Hi, I'm Steven De Costa. After two inspiring days of sessions and conversations here at IDW2025, I wanted to share a direct connection to a community where some of the ideas we're discussing are being put into practice every week. I think the themes of FAIR data, responsible AI, and reproducible science resonate deeply with the work being done in the MLCommons Datasets Working Group. I'm a regular participant in their Friday calls—which is a 5 AM start for me here in Australia—and I find the work incredibly valuable. Since the next meeting happens to be this Friday morning, I quickly put this page together. My hope is to give any interested folks at IDW a friendly and timely opportunity to drop in, listen, and connect with this global community. ## Here are the details for this Friday's call: This is a perfect opportunity to connect with the group's work and see how frameworks like CDIF and RO-Crate and research data in general align with the mission to build large-scale, open datasets for machine learning. ## Meeting details Event: MLCommons Datasets Working Group Call Date: Friday, 17 October 2025 Time: 5:05 AM – 6:00 AM AEST (Brisbane Time) [ Join with Google Meet ](https://meet.google.com/wgn-qnek-ugm) [ Add to Google Calendar ](https://calendar.google.com/calendar/render?action=TEMPLATE&text=MLCommons%20Datasets%20Working%20Group%20Call&dates=20251016T190500Z/20251016T200000Z&details=Dial-in%20Information%3A%0APhone%3A%20%2B1%20406-851-5125%0APIN%3A%20452%20500%20798%20%23%0A%0Ahttps%3A%2F%2Fmeet.google.com%2Fwgn-qnek-ugm&location=https%3A%2F%2Fmeet.google.com%2Fwgn-qnek-ugm) Dial-in Information: \* Phone: +1 406-851-5125 \* PIN: 452 500 798 # Why I thought this would resonate at IDW The IDW2025 theme “Data for Positive Change” is the very heart of this group’s mission. This is your chance to connect with peers building the next generation of public data, bring your expertise in data standards, and get a friendly introduction to the work MLCommons is doing. ## Hope this is a useful connection. Enjoy the rest of the conference! ## Steven De Costa Chairman, Link Digital & a fellow IDW2025 attendee [ Linkedin ](https://www.linkedin.com/in/stevendecosta/) ![Steven De Costa](https://linkdigital.com.au/wp-content/uploads/2024/06/Steven-Updated-Photo.png) --- ### [Confirmation notice](https://linkdigital.com.au/confirmation-notice/) **Published:** November 23, 2017 **Author:** Steven De Costa **Content:** # Thanks for contacting us! # We will be in touch with you shortly. [← Back to main page](https://linkdigital.com.au/) --- ### [CKAN & Open Data](https://linkdigital.com.au/ckan-and-open-data/) **Published:** October 23, 2024 **Author:** Steven De Costa **Excerpt:** Looking for experts in building systems for data catalog and metadata management? Exceptional end-to-end data hubs and portals based on CKAN. Get in touch. **Content:** # Publish your data easily with CKAN! Are you looking for a powerful data management system for data publishing? Interested in using CKAN as your open data repository? [ Get in touch ](/get-in-touch) ![](https://linkdigital.com.au/wp-content/uploads/2024/10/ckan-logo-1.webp) ## CKAN and Link Digital Whether you're working for a small organization, a research institution, or a government agency, the team at Link Digital can help to deliver exceptional end-to-end professional services surrounding data publishing on CKAN. ## Features ![API](https://linkdigital.com.au/wp-content/uploads/2024/10/api.svg "API") ### API CKAN’s Action API is a powerful, RPC-style API that exposes all of CKAN’s core features to API clients. ![Visualisation](https://linkdigital.com.au/wp-content/uploads/2024/10/visualisation.svg "Visualisation") ### Visualisation CKAN’s data previewing tool has a host of powerful features for previewing data stored in the DataStore. ![Datastore](https://linkdigital.com.au/wp-content/uploads/2024/10/datastore.svg "Datastore") ### Datastore The CKAN DataStore extension provides an ad hoc database for storage of structured data from CKAN resources. ![Publish & Manage Data](https://linkdigital.com.au/wp-content/uploads/2024/10/publish_manage.svg "Publish & Manage Data") ### Publish & manage data An intuitive web interface allows publishers and curators to easily register, update and refine datasets. ![Geospatial](https://linkdigital.com.au/wp-content/uploads/2024/10/geospatial.svg "Geospatial") ### Geospatial Extensions provide advanced geospatial features, covering data preview, search, and discovery. Ability to preview where structured data with location information is. ![Search & Discovery](https://linkdigital.com.au/wp-content/uploads/2024/10/search_discovery.svg "Search & Discovery") ### Search & discovery CKAN provides a rich search experience which allows for quick ‘Google-style’ keyword search as well as faceting by tags and browsing between related datasets. ![Metadata](https://linkdigital.com.au/wp-content/uploads/2024/10/metadata.svg "Metadata") ### Metadata A CKAN portal provides a rich set of metadata for each dataset. ![Filestore](https://linkdigital.com.au/wp-content/uploads/2024/10/filestore.svg "Filestore") ### Filestore FileStore allows users to upload data and image files. ## Request a live demo Get in touch today ![Questions](https://linkdigital.com.au/wp-content/uploads/2024/10/questions-section-300x177.webp) ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments Submit ## Why work with Link Digital? For more than a decade, Link Digital has had a solid track record of success in the field of open data. With CKAN experts in Europe and Australia, we provide managed CKAN hosting, support, extension development, and theming to clients globally. Today, we are recognised as one of the CKAN stewards by the Open Knowledge Foundation. Aside from CKAN, we also provide a wide range of expertise, including: ![Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/10/link-circle-768x527.webp) ![AWS](https://linkdigital.com.au/wp-content/uploads/2024/10/aws-section-430x218.webp "AWS") ### Amazon Web Services We provide managed hosting, support and cloud architecture services to the non-profit, Government and education sectors and are recognised via the Public Sector and Open Data partner programs. [ I need managed hosting ](/get-in-touch) ![Drupal](https://linkdigital.com.au/wp-content/uploads/2024/10/drupal-right-430x218.webp "Drupal") ### Drupal We develop digital experiences, services and dashboards with a strong emphasis on supporting content authors and end users. We currently leverage our 17 years of experience in Drupal based projects. [ Talk to a Drupal expert ](/get-in-touch) ![CKAN](https://linkdigital.com.au/wp-content/uploads/2024/10/ckan-section-e1737530035764.webp) ### CKAN, the leading data management system CKAN is a powerful open source data management system that makes data easily accessible. It is a tool for making open data websites similar to other content management systems like WordPress – but for data , instead of pages and blog posts. CKAN helps you manage and publish collections of data and is used by national and local governments, research institutions, and other organisations who collect a lot of data. [ Talk to a CKAN expert ](/get-in-touch) ## Frequently asked questions 1. Can I integrate CKAN with my CMS or existing catalogues ? Yes, it is ‘white-label’ software as smooth integration is important for many users. The standard recommendation is for side-by-side integration. Extensions for Drupal and WordPress integration also exist, and the API makes it straightforward to add support for other CMS’s and third-party catalogues. 2. How often is CKAN updated ? We apply security patches as they are released. Major release updates are done at clients’ request. 3. How much does CKAN cost ? CKAN is open source, free software. This means that you can use it without any license fees but more importantly, when you choose CKAN for your catalogue, you are also ensuring that you retain all rights to the data and metadata you enter. This allows you the freedom to move it elsewhere or manipulate it with your own tools without restriction. ### Got further questions?  Get in touch with our CKAN Experts ![Questions](https://linkdigital.com.au/wp-content/uploads/2024/10/questions-section-e1737530255647.webp) ### We've encountered an error Please Select... CKAN and Open Data Services Drupal and Web Development Services AWS and Cloud Hosting Services Two or more of the above Other Yes, I'd like to receive marketing emails from Link Digital. You can unsubscribe at any time. For details, see our [Privacy Policy](https://linkdigital.com.au/terms-and-conditions/#:~:text=WHY%20DO%20WE%20COLLECT%2C%20USE%20AND%20DISCLOSE%20PERSONAL%20INFORMATION%3F). Comments Submit ### About Link Digital *Established in 2002, Link Digital is the trusted partner of governments, NGOs, and enterprise organizations in building data hubs and open data portals.* As developers, implementers, and major contributors to CKAN since 2012, Link Digital provides CKAN hosting, support, and maintenance, as well as consulting and design services. Their team makes data discoverable, searchable, and easy to interpret, helping organizations make sound decisions and solve real-world problems. [ Facebook ](https://www.facebook.com/LinkDigital/) [ Youtube ](https://www.youtube.com/@link-digital) [ Linkedin ](https://www.linkedin.com/company/link-digital/) --- ### [Data Practices Manifesto](https://linkdigital.com.au/data-practices-manifesto/) **Published:** February 22, 2018 **Author:** Steven De Costa **Content:** # Data Practices ##### Over 20 years in the industry | CKAN experts since 2012 --- ## Portfolio ### [CKAN implementation for Norwegian Public Roads Administration (NPRA)](https://linkdigital.com.au/case-studies/norwegian-public-roads-administration-data-portal/) **Published:** April 5, 2026 **Author:** Andrew Nette **Excerpt:** See how Link Digital utilised CKAN to build a scalable open data portal for the Norwegian Public Roads Administration (NPRA), enhancing data accessibility and transparency. **Content:** ## **Project snapshot** - **Client:** Norwegian Public Roads Administration (Statens vegvesen) - **Industry:** Government / Transportation - **Core technology:** CKAN Open Data Platform - **Year implemented:** 2020 - **Key solution:** Centralised data harvesting and metadata management. - **Outcome:** Improved compliance with EU data directives and enhanced public transparency. ## **About the client** The [Norwegian Public Roads Administration (NPRA)](http://www.vegvesen.no/) is the administrative agency responsible for the national road network as well as for road users and vehicles. Operating under the aegis of the Country’s Ministry of Transport, NPRA’s ‘principal tasks are developing and creating conditions for an effective, environmentally friendly, future-oriented and safe road transport system.’ This includes: - The planning, construction, operation and maintenance of the national road network. - Vehicle inspection and requirements. - Driver training and licensing. - Road traffic safety. - Climate and environmental issues and urban transport mobility. The [NPRA’s data portal](https://dataut.vegvesen.no/) was set up in 2020. In addition to making related data public, the portal shares data with the Government’s [Norway’s national data portal](https://data.norge.no/datasets), which in turn shares data with the European Union’s data portal, [European Data](https://data.europa.eu/en). ![The homepage of the Norwegian Public Roads Administration Open Data Portal](https://linkdigital.com.au/wp-content/uploads/2024/09/Screenshot-2024-09-04-at-6.07.15 PM-1024x592.png)Home page of the Norwegian Public Roads Administration Data Portal ## **Objectives of the NPRA data portal** The precursor to the portal was a hard-coded HTML page with a list of data. The NPRA copied that information manually across to the open data portal. The data portal is aimed at anyone that might have a use for its data, whether they be commercial entities, journalists, researchers, students, or just interested members of the public. The NPRA data portal has three levels of data accessibility: - Data entries that are completely open. - Entries that have public information about data but which require permission to access. For example, this entry on [case management system for traffic accidents](https://dataut.vegvesen.no/en/dataset/faglosning-for-trafikkulykker). While it is public knowledge that NPRA has the data, Norway’s privacy law means that only people and organisations that are covered by the legal exemption mentioned can apply for full access to the data. - Data entries that are for internal use only. The NPRA wanted a portal that was flexible and searchable, and had an automatic export to the national portal using the [Data Catalog Vocabulary-Application Profile (DCAT-AP),](https://linkdigital.com.au/news/2024/09/what-is-dcat-and-why-is-it-important-for-data-catalogs-and-open-data-portals/) an extension based on [Data Catalogue vocabulary ](https://www.w3.org/TR/vocab-dcat/)and designed specifically for describing public sector datasets in Europe. The DCAT-AP standardises how metadata about public sector datasets is published, improving their discoverability and interoperability across different data portals across the European Union. Since establishing their open data portal, the NPRA have been making gradual improvements, including extending the number of metadata fields and adding an API catalog, a centralised repository of the APIs, both internal and external, of interest or relevance to an organisation. ## **Link Digital’s role** [Link Digital](https://linkdigital.com.au/) helped to build and finalise the NPRA’s open data portal and has undertaken ongoing hosting and management of the portal since it was set up. According to Hilde Austlid, senior engineer at NPRA, [CKAN ](https://linkdigital.com.au/ckan/)was identified as the preferred software for the portal early in the scoping process to establish the portal. “When we started looking for data portals, we wanted something that did most of what we wanted out of the box, and which didn’t lock us to a specific provider. [CKAN ](https://linkdigital.com.au/ckan/)was pretty much the only one we found.” The portal presents information in Norwegian and English and the main challenge in its development was getting the content translated, including translating tags for the datasets. For this,[ Link Digital](https://linkdigital.com.au/) used a CKAN extension that is quite new in our work called [ckanext-fluent](https://github.com/ckan/ckanext-fluent). This provides a way to store and return multilingual fields in CKAN datasets, resources, organisations and groups. ## **Benefits and future plans** The portal has made it far easier for NPRA to share high quality data with the public and the Norwegian Government’s national data portal, leading to overall increased data discoverability and shareability. Future plans for the portal include improving the portal’s data descriptions, refinements to the portal’s permission settings and work to encourage more people and organisations to use it. The NPRA is also keen to expand the API catalog, by including more meta data fields to conform closer to the [DCAT-AP standard.](https://linkdigital.com.au/news/2024/10/enhancing-dcat-support-in-ckan-dcat-ap-v3-scheming-integration-and-more/) View the live portal:[ https://dataut.vegvesen.no/ ](https://dataut.vegvesen.no/) ## **Build your open data portal with Link Digital** [Get in touch](https://linkdigital.com.au/get-in-touch/) and one of our CKAN experts will reach out. **Portfolio Categories:** All case studies, AWS, Capabilities, CKAN, CKAN Migration, End to end CKAN Services, Europe, Government/Public Sector, Industry, Managed Hosting, Open data portal, Region, Technology Infrastructure --- ### [Improved internal data discoverability to help the design department of a major European University](https://linkdigital.com.au/case-studies/ckan-data-statistics-platform-european-university/) **Published:** October 23, 2025 **Author:** Andrew Nette **Excerpt:** Link Digital implemented the CKAN data and statistics platform to improve the internal data organisation and search capacities of the design department of a major university in northwestern Europe. **Content:** ## **Overview** Link Digital delivered a tailored CKAN data and statistics platform to improve the internal data organisation and search capacities of the design department of a major university in northwestern Europe. The department delivers a wide range of bachelor’s, master’s, associate degree, and minor programs in applied sciences, and includes a variety of hands-on educational and research opportunities, many of them taught in English for international students. ## **The challenge** The department needed to improve its internal data organization and search capabilities, making a large array of Power BI dashboards and online resources more discoverable for its internal staff and students. ## **The solution** Link Digital was engaged to implement a CKAN-based platform for the university design department and deploy it in the university’s existing Azure environment. ## **The implementation** The CKAN implementation hosts metadata but no datasets and is instead used to aggregate and simplify access to a large array of Power BI dashboards and on-line resources hosted by the department, making them more discoverable internally within the university. Link Digital was able to create landing pages within the portal, to enable users to search for these dashboards and resources by category, i.e., students, finance, research, personnel, etc. Clicking on a landing page takes the users to the dashboards and resources specific to that topic, then enables them to move back easily to the main portal page, for an improved user experience. The portal also includes: - Integrated single sign-on, allowing users to log in to the portal once with a single set of credentials and gain access to multiple dashboards and applications. - The integration with the department’s themed experience/interface. - Multiple CKAN extensions, built to accommodate different file types, such as PDF, Word, html, CSV and excel, etc. - The portal uses the Amazon Web Services Cloud for hosting, with Link Digital providing support and maintenance. ## Read: [Inter-American Development Bank’s Open Data Catalogue \[Case study\]](https://linkdigital.com.au/case-studies/inter-american-development-bank-open-data-catalogue/) **Portfolio Categories:** All case studies, Application Development, AWS, Azure, CKAN, Europe, Internal data hub, Managed Hosting, Region --- ### [Upgrading a national OECD government open data portal to a full CKAN environment](https://linkdigital.com.au/case-studies/upgrading-a-national-oecd-government-open-data-portal-to-a-full-ckan-environment/) **Published:** August 26, 2026 **Author:** Kate Sampher **Excerpt:** Link Digital migrated a national government open data portal to a full CKAN environment, securing 100k+ datasets with zero downtime. Read the case study. **Content:** ## **At a glance** - A major upgrade of a national OECD government data portal, including a complex migration process from a mixed software configuration to a full CKAN solution, with no service disruption or downtime - Data: the portal currently hosts over 100,000 data sets in a range of formats, syndicated from over a thousand government departments and statutory bodies - Tech stack: CKAN and Drupal - Services delivered: upgrading CKAN, managing the migration process, customised software solutions, data governance and standards alignment, improved accessibility, and ongoing support and maintenance ## **The client**: A national OECD government ## **Project summary** The portal is the Government’s central open catalogue for the discovery of public data, featuring tabular, spatial and relational data with hosted APIs and the option for agencies to link data and services hosted by other government sources at a national, state, and local level. The portal has been operating for over a decade. As the national data ecosystem evolved and the portal transitioned from one statutory authority to another, the government engaged Link Digital to securely transition the portal exclusively to [the Comprehensive Knowledge Archive Network (CKAN)](https://ckan.org/), as opposed to its previous mixed software architecture in which CKAN was only one part of the tech stack. The client wanted the new solution to continue to harvest existing data from many sources, meet strict accessibility guidelines, and feature a highly customisable front end to support supplementary content and changing requirements. This project demonstrates Link Digital’s CKAN expertise and our ability to deliver secure, national-level high-performance open data infrastructure for national government. ![Datasets interface based on CKAN - Link Digital](https://linkdigital.com.au/wp-content/uploads/2026/08/search-datasets.webp)*Datasets view with CKAN* ## **Timeline and deployment**: Link Digital was engaged late 2024, and the portal went live mid-2025. Link Digital has been involved in improving the quantity and quality of the government’s open data and the portal’s tech stack for much of the period since it was first established in the beginning of the twenty-tens. Early on we were engaged as the primary technical partner to manage, host, and maintain the early CKAN infrastructure on Amazon Web Services, and provided 24/7 infrastructure monitoring, security patching, customised extension development, and the deployment of dataset APIs (DataStore). A different government agency took charge of the portal in the early 2010s. While CKAN remained as the core data management technology, another open source software was integrated into the platform to administer its front-facing search features and federated registry layer. When the portal was transferred to a new agency Link Digital was engaged to help consolidate the portal to a new all-CKAN environment and install Drupal as the site’s content management software. ## **Technology stack** - Platform migration to all CKAN environment - Drupal for content management services While the client now hosts the portal in-house, Link Digital continues to provide managed support services. ## **The portal’s objectives** The portal is the Government’s official national portal, supporting its policy of requiring all non-sensitive government data to be open by default and encouraging the sharing and re-use of the data for economic growth, improved service delivery outcomes and a more informed citizenry. ## **Data specifics** The portal currently hosts over 100,000 data sets. A proportion of those are native to the site, while the remainder have been harvested from other sites and republished on the portal, and that volume expands continuously. Data on the platform is available in machine-readable and open standard formats to allow automated querying and API access. The data set library spans broad subject classifications and data from a wide range of formats, including: - Tabular & Structured: CSV, XLSX, JSON, XML - Geospatial & Mapping: WMS (Web Map Service), ESRI MapServer, KML, GeoJSON, and X-NetCDF - APIs & Web Services: Direct RESTful CKAN Data API endpoints for live data table querying. Data is syndicated from over a thousand organisations. These include: - National and state government departments and statutory bodies - Local government - Observatories - Public collecting institutions such as museums and libraries - Schools and educational facilities The portal also hosts publicly funded research data and datasets from private institutions that are in the public interest, and provides metadata and other information regarding unpublished data or datasets available for purchase. Anyone can freely search, view, and download publicly listed datasets without registering or providing personal information. To publish data on the portal, users must have an account with a government email address at a national, state or local level. In rare instances a data set hosted by an external organisation linked by the national open data portal may require a separate login, registration, or agreement to specific usage terms. ## **Challenges and Link Digital’s Role** The client was keen to transition the portal to a single, unified CKAN architecture to make it simpler to administer and reduce maintenance costs. The new portal utilises CKAN for all back-end data management, and Drupal for front-end content. Link Digital’s work involved the following: ### ***Successfully managing the complex migration process*** The migration to an all-CKAN environment was the most complex part of the service engagement. Maintaining all the datasets native to the portal while reintegrating the harvester process seamlessly back into CKAN was challenging due to the outdated and insecure versions of CKAN being used by the previous authority overseeing the portal. We worked with the new owner, who had no CKAN experience, to fully upgrade CKAN and engineer the migration of the site to a new domain, while ensuring total data integrity and continuity. We smoothly transitioned the architecture and seamlessly harvested all existing harvest sites to ensure total data integrity and continuity. While the portal was being migrated there was only a brief period of a few days during which new datasets could not be uploaded into the portal, but otherwise it remained fully online and accessible to the public. ### ***Customised software solutions*** Implementing custom extension plugins and maintaining hosted APIs (such as tabular, spatial, and relational data query endpoints). The search and filter functions now allow users to search across a massive library of datasets and filter them by tags, organizations, and file formats (such as CSV, XLSX, HTML, WMS, and ESRI MapServer). ### ***Complete data transparency*** The new data federal architecture includes a harvesting mechanism designed to identify and communicate the original source of data sets to users, effectively managing potential duplicate data from other government open data portals. This metadata-driven approach ensures users can navigate to the original publisher when necessary. ### ***A customised Drupal front end*** We developed a new, dynamic front page using Drupal, designed to be highly customisable so it can meet evolving requirements. This included the implementation of a “Toolkit” feature, empowering administrators to easily create and manage supplementary pages (e.g., About, Privacy, and user toolkits). ### ***Data governance and standard alignment*** Metadata structures conform to open standards, like the [Data Catalog Vocabulary](https://www.w3.org/TR/vocab-dcat-3/). This enables seamless data harvesting and cross-catalog interoperability between national, state and local portals. ### ***Improved accessibility*** The new version of the portal was audited to adhere to strict accessibility standards. All identified issues were subsequently addressed by the team to ensure the latest version of the portal met government accessibility mandates and ensured inclusive public access. ### ***Ongoing proactive support and maintenance*** Link Digital is providing end-to-end service transition, custom development, and ongoing managed infrastructure. This covers day-to-day technical support, proactive system maintenance, critical security updates, and minor application development tasks to continuously improve the platform. ![View of Dataset page](https://linkdigital.com.au/wp-content/uploads/2026/08/dataset-page.webp)*View of Dataset page* ## **Benefits of the portal** The portal continues to serve as a single discovery platform where anyone – citizens, researchers, developers, and businesses – can access anonymised real-world public data published by government agencies at all levels, and civil servants can upload datasets. The updating and migration of the CKAN instance has improved security and ensured full compliance with government accessibility standards. Development continues on a secure platform for internal data sharing between government departments. ## **Link Digital: global CKAN expert** The project demonstrates Link Digital’s ability to manage large-scale, national-level open data infrastructure. By combining CKAN data management with a flexible Drupal front end, strict accessibility compliance, and reliable monthly managed services, we have established a clear blueprint for delivering secure, high-performance CKAN ecosystems for national governments, with minimal service disruption or downtime. The project is also a textbook case study in the adaptability and flexibility of CKAN, including its ability in terms of working with other software components. **Portfolio Categories:** All case studies, Application Development, Australia and New Zealand, CKAN, CKAN Migration, Drupal, End to end CKAN Services, Government/Public Sector, Industry, Open data portal, Region, Technology Infrastructure **Portfolio Tags:** CKAN, Drupal, Government Data Portal --- ### [CKAN-powered data portal delivers secure, efficient climate projections for NSW Government](https://linkdigital.com.au/case-studies/ckan-powered-data-portal-delivers-secure-efficient-climate-projections-for-nsw-government/) **Published:** April 22, 2026 **Author:** Andrew Nette **Excerpt:** Discover how CKAN and Link Digital powered the NSW Climate Data Portal with climate projection data for government and researchers. **Content:** Helping the New South Wales Government share large-scale climate data efficiently and securely ## **Client** [New South Wales Department of Climate Change, Energy, the Environment and Water](https://www.nsw.gov.au/departments-and-agencies/dcceew) (the department) ## **Project** New South Wales Climate Data Portal (the Portal) ## **Link to the site** - Home page: - Portal page: ## **Project summary** Access to reliable, high-resolution and up-to-date climate data is important for government, industry and communities. It is vital to support building and infrastructure planning, water catchment management, disaster risk assessment and preparedness, and the development of climate change adaptation and resilience strategies. Utilising [the Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN) – [Link Digital](https://linkdigital.com.au/) assisted the department to implement an innovative and cost-effective solution to make their regional scale climate datasets more discoverable and shareable to a broad range of stakeholders and users, in a highly secure environment. ![A screenshot of Climate Data Portal by the New South Wales Government](https://linkdigital.com.au/wp-content/uploads/2026/04/screenshot-NSW-climate-data-portal.png)*A screenshot of Climate Data Portal by the New South Wales Government* ## **Technology services provided** - Two CKAN instances, one public facing and searchable, the other behind the department’s firewall for Portal administration - Integration of CKAN instances with a range of third-party software infrastructure: the department’s internal data workflow systems; their secure application programming interface (API), through which the two CKAN portals communicate with each other; and the department’s data storage facility where the climate datasets are stored on the internal CKAN portal. This last point is crucial to understanding the challenges involved in the project. While using CKAN to enable better discovery and sharing of its large-scale climate data, and catalogue high quality metadata, the department securely maintains the data on its internal servers. - Further customisation of the CKAN instances with the department’s [Amazon Web Services S3 cloud storage bucket](https://aws.amazon.com/s3/), on which requested data is stored while awaiting download. - In its early stages, Link Digital undertook managed hosting of the Climate Data Portal, until the detailed and secure architectural design of the department’s internal data systems infrastructure was sufficiently developed to migrate hosting to their internal network. The project is now hosted in-house. - Ongoing support and maintenance of both CKAN instances. ## **About the client** The NSW Department of Climate Change, Energy, the Environment and Water is the key agency responsible for protecting the state’s environment and heritage. It conserves and protects the state’s natural environment, ensures sustainable management of water resources, and leads the way on climate action by driving the sustainable transition to a net zero economy. ## **Period of working with the client:** A ‘beta version’ of the NSW Climate Data Portal began in 2020, and it went live in early 2021. Work on the current Portal began at that time and went live in September 2025. In this time frame, the project worked through the technical design to implement a complex operation system that could be managed and hosted the external and internal portals. ## **Project objective** The Portal has been designed to provide a simple and straightforward way to share important but also highly complex and very large climate datasets with end users experienced with using climate datasets. The climate projections come from the [NSW and Australian Regional Climate Modelling (NARCliM)](https://www.climatechange.environment.nsw.gov.au/narclim) program. Led by the NSW Government, with support from other Australian state governments, universities, and research institutions, the latest generation of NARCliM, version 2.0, delivers high-resolution regional climate projections for 1951 to 2100 for NSW and south-eastern Australia on a 4km grid. It also covers the broader Australasian region, including New Zealand and parts of Indonesia, and extends out into the Indian Ocean on a 20km grid. It uses the global climate models and greenhouse gas emissions scenarios from the [Coupled Model Intercomparison Project Phase 6](https://wcrp-cmip.org/cmip-phases/cmip6/) (CMIP6), as used by the United Nations [Intergovernmental Panel on Climate Change](https://www.ipcc.ch/). The department downscales this data using the [Weather Research and Forecasting (WRF) model](https://www.mmm.ucar.edu/models/wrf) to ensure it represents the Australian context, factoring in regional and local atmospheric, climatic, and land conditions to make it more relevant for local users in these areas. The NARCliM project generates historical and future climate and atmospheric variables and indices. The scientific design of NARCliM2.0 is described more in detail [in this 2025 peer-reviewed scientific journal article](https://gmd.copernicus.org/articles/18/671/2025/gmd-18-671-2025.html). The department’s desire to give stakeholders access to this data required an application that takes the complex data structure of NARCliM data and organises data in an easy to understand and navigate interface. The project comprises two [CKAN](https://linkdigital.com.au/ckan/) instances: a public facing portal and an internal portal, linked by a secure API. On the public portal, users can search for NARCliM data, displayed as key metadata fields, refine their data selection and request the datasets. The dataset request and its parameters are communicated via the secure API to the CKAN internal portal, connected to the department’s secure internal data management system where data requests are packaged and then uploaded to the Amazon cloud storage for users to download. Publicly available data (represented by its metadata) is first registered in the internal portal and then pushed to the [AWS](https://linkdigital.com.au/aws/) S3 bucket. Using a suite of CKAN filtering tools, users can search by time scale/frequency, scenario, spatial domain (extent) and type of data, such as climate indices or climate variables. The Portal provides both bias adjusted and post-processed data. Through the filtering tools users have fast and easy access to a subset of datasets. Additionally, once users identify the dataset they want with the filtering tools, the Portal offers a selection of tools to refine the dataset choice spatially, by selecting an area or a point location, and temporally by selecting a date range and then selecting the desired output format. Once this refined selection is added to the data cart, users can review and request a download. While anyone can browse the metadata on the public portal, users must register to access and download datasets. This enables the department’s staff to keep a record of what is downloaded, which helps if users have questions or need assistance. It also enables staff to track needs and feedback from user cohorts and data usage more effectively. It is also important to stakeholder engagement, enabling the department to communicate with users about Portal features and to notify them of new datasets. To aid with discoverability, the public portal home page hosts a glossary of terms, a dictionary of variables and additional support information to assist users make informed data selection choices. The Climate Data Portal is intended to support a range of data users, including researchers, scientists, climate risk analysts, and specialists across government, community and the private sectors. Through communication activities, the department provides the public with Portal information to build awareness of NARCliM climate projections and access. ## **Project’s data specifics** As of this case study’s publication date, users can search metadata for over 7000 climatic datasets and collections on the Portal site. The Portals provide data in three output formats: - NetCDF and GeoTIFF for area data. - CSV or comma-separated values for point data. Users can pick or enter a point on a map and export it to CSV format, to generate time series information for a location. Users can also export areal data to NetCDF, a self-describing file format and library for storing and accessing large, multidimensional scientific data, or as a GeoTIFF of an area location for use in a Geographic Information Systems or other geospatial application. The Climate Data Portal follows the guidelines for metadata formatting and file naming conventions of the Coordinated Regional Climate Downscaling Experiment ([CORDEX](https://cordex.org/)). CORDEX is a global initiative by the World Climate Research Programme, aimed at improving and coordinating regional climate downscaling projects. Priority CORDEX metadata fields are displayed with each dataset. NARCliM2.0 is compliant with CORDEX conventions. The Climate Data Portal is fully [DCAT](https://linkdigital.com.au/news/2024/09/what-is-dcat-and-why-is-it-important-for-data-catalogs-and-open-data-portals/ "DCAT") compliant. ## **Technical challenges and Link Digital’s role** The Climate Data Portal is different to many [CKAN-powered portals Link Digital has worked on](https://linkdigital.com.au/case-studies/), in that only the metadata, not the datasets, are hosted and managed in the CKAN instances. The department specifies that data be stored securely and managed at its data centre which hosts data for research, modelling and analysis. Link Digital had to integrate the two CKAN instances with the department’s internal data storage and workflow processes in such a way as to ensure that the data was secure and unable to be compromised. The most challenging part of the job was integrating the CKAN instances into their secure API, because it had to be architected in such a way that there was a complete separation between the public/external data portals and the back-end infrastructure of the department’s data farm. DCCEEW provided all the metadata and Link Digital had to map it onto their specified architecture. The client’s desired configuration also meant engineering a solution that anticipated the potential pain points for the various links in the chain and fault proof each of them. This required an in-depth understanding of the Portal’s data workflow, which is as follows: - After browsing and selecting data, as represented by its metadata, on the public portal, a user can request a subset of the NARCliM data. - This request is set via the secure API to the internal portal, which is used to organise metadata and catalogue data requests. - Once the request has been received by the internal portal, data is retrieved from the filing structure per its specifications. - The dataset is packaged up in a zip file and sent via the API to the AWS S3 bucket, where it is stored for retrieval. - The user is notified via email with a link that their requested data is ready to download. They have seven days to collect it, before it is deleted. - The department’s Portal team receives notification of any problems in the process. Why did the department want the Climate Data Portal configured like this? AWS cloud storage is an appropriate resource for the temporary storage of requested datasets, until it can be downloaded by the user. Maintaining the data storage on internal systems keeps the data secure and ensures it can exist as a single source of truth. This way the department’s staff only need to manage the source of truth datasets, which brings maintenance and cost efficiencies. The department selected CKAN for three main reasons: - It is relatively simple to use and able to provide data to users in a straightforward way, while CKAN’s filtering and searching tools made it easy for the users to search and find what they wanted. - CKAN is used extensively throughout the NSW government. It is easily configurable to the NSW Government’s website design and accessibility standards, and provides a comparable experience to other NSW Government portals, such as the [Sharing and Enabling Environmental Data (SEED) Portal](https://www.seed.nsw.gov.au/), the [NSW Planning Portal](https://www.planningportal.nsw.gov.au/), and the [Flood Data Portal](https://flooddata.ses.nsw.gov.au/) (all of which were built by Link Digital). - Interoperability: The Climate Data Portal is able to syndicate its data records to NSW SEED and Planning portals, as another avenue to expose climate data to the public. ## **The benefits of NSW’s Climate Data Portal** The Portal increases exposure to important climate data delivery gaps for practicing and experienced users – people who use localised climate data in their day-to-day occupation and understand and can analyse it. Now that the site is live, users will be able to provide feedback to support future improvements. With its design, implementation and operational procedures, the NSW Climate Data Portal provides users with an opportunity to enhance awareness and access to localised climate projections data. --- [Link Digital](https://linkdigital.com.au/) is ready to start a conversation with your team on your open data needs. [Contact us and tell us about your project](https://linkdigital.com.au/get-in-touch/). **Portfolio Categories:** All case studies, Australia and New Zealand, AWS, Capabilities, CKAN, End to end CKAN Services, Environmental/Climate Change, Government/Public Sector, Higher Education/Research, Industry, Internal data hub, Managed Hosting, Open data portal, Region **Portfolio Tags:** case study, Government --- ### [Future-proofing an enterprise-level data catalogue that shares information on food security ](https://linkdigital.com.au/case-studies/data-catalogue-food-security/) **Published:** August 25, 2025 **Author:** Andrew Nette **Excerpt:** The organisation wanted to modernise its enterprise level public data catalogue to make it more secure and efficient. Using CKAN. The catalogue collects data on agriculture and sustainable farming from a wide range of sources and shares it with stakeholders in Africa, Asia, Europe, Latin America, and the Middle East. **Content:** ## **The client** A large international development agency working to support food security and promote sustainable agricultural development. ## **Project summary** The client wanted to modernise its enterprise level public data catalogue to make it more secure and efficient. Using CKAN – [the Comprehensive Knowledge Archive Network](https://ckan.org/) – the catalogue collects data on agriculture and sustainable farming from a wide range of sources and shares it with stakeholders in Africa, Asia, Europe, Latin America, and the Middle East. The catalogue acts as a secure means of storing and sharing this data, turning it into actionable information that can contribute to economic growth while promoting the sustainable use of natural resources. [Link Digital](https://linkdigital.com.au/) upgraded the existing CKAN instance, which is used for the data cataloguing component, and refactored a critical custom-built integration with Google Cloud and, in particular, [Google Cloud BigQuery](https://cloud.google.com/bigquery), a data warehouse and analytics centre that enables users to store, manage, and analyse large volumes of structured and semi-structured data. We adapted the client’s current data pipeline procedures and practices to mesh with this new configuration, including modifications which enabled users to search and preview very large datasets. The project showcases Link Digital’s in-depth CKAN expertise. It is also a textbook example of CKAN’s flexibility in terms of working with other software components, and the ‘no vendor lock-in’ promise of open source software more generally. ## **Timeline and deployment** Link Digital was subcontracted to provide specialist services to the project, over the period January to June 2024. The work was executed using an Agile methodology, with bi-weekly sprints. Regular status meetings ensured transparency and excellent communication between the various stakeholders. The final production deployment took place on schedule, with Link Digital’s expert senior developers remaining on standby for real-time support. ## **Technology Infrastructure** The project involved the following technological components: - CKAN upgrade– from 2.8 to 2.10 – as the front end for Google Cloud, where the data from the catalogue was stored. - A connection with Google Cloud and Google Cloud Big Query, and the development of customised Google Cloud tags and tag templates. - CKAN plugins, including [*ckanext-jsonschema*](https://github.com/ccancellieri/ckanext-jsonschema), which provides an extensive set of functionalities to introduce [JSONschema](https://json-schema.org/) based metadata types into CKAN. ## **The catalogue’s objective** The client’s catalogue is a public facing application designed to provide global open access to agroinformatics related data. Agroinformatics is the use of data-driven decision making in relation to agriculture, to assist farmers make more informed decisions and ensure greater productivity and environmental sustainability in relation to food production. ![Organisations datasets - example - food security open data portal](https://linkdigital.com.au/wp-content/uploads/2025/08/Image-food-security-ODP-webp-1024x576.webp)*Example of a dataset page using CKAN* ## **How data is sourced** The data is sourced from a diverse range of sources, and includes topics ranging from crop planting, soil health and fertiliser use, to pest control, supply chain optimisation and measures to help with disaster preparedness and climate change abatement and mitigation. It offers a range of tools for customising data visualisation and producing data maps and statistical time series, to help configure data into actionable insights. These are used by governments and other stakeholders, including digital agriculture experts, economists, national governments, not for profits, and farmers groups, including in regional and remote areas. Stakeholders can search for information by keyword, organisation, country, resource type and theme. ## **Data specifics** The catalogue contains over two million data layers, thousands of statistics series and approximately 4,000 metadata records. It includes data in CSV, XLS and XML formats, as well as geospatial data, including advanced geospatial modelling. This is aggregated from a vast range of sources, including businesses, not for profit organisations, inter-governmental agencies, academics, economists, and space agencies. ## **Challenges and Link Digital’s role** ### Software modernisation The core problem faced by the client – the need to update the key software components to modernise the catalogue’s operations – is a common one in the lifecycle of enterprise software. Nonetheless, it required some complex customisation work. Not only did Link Digital upgrade the existing CKAN instance, and its Python interface, to make the catalogue more functional and secure, we implemented several plugins to make the benefits of CKAN operable within Google. We connected CKAN to BigQuery, developing a BigQuery-csv resource type that allowed users to upload a CSV file, which would then be ingested into a BigQuery table via a cloud function. Ensuring all information was fetched ‘on the fly’ by Google Cloud, rather than being stored in CKAN, helps to maintain a single source of truth. The platform relied on a highly specific CKAN extension*, ckanext-jsonschema*, to integrate with Google BigQuery. This was not a standard off the shelf feature but had to be custom built. A standard CKAN upgrade would likely break the link between CKAN and BigQuery, thus disrupting data workflows and the functionality crucial to the platform’s mission. CKAN has powerful capacity in relation to metadata, including enabling users to customise their metadata schema with additional information. However, the client had a completely different schema for metadata. We focused on improving the problems inside their scheme rather than insisting that they change it. ### Working with large datasets Another major challenge was the size of some of the client’s datasets, literally hundreds of gigabytes of data. This necessitated allowing a user on the CKAN side to search datasets stored in the client’s Cloud and download only part of the data using Google BigQuery, to enable a quick overview. In this way, the CKAN front end of the catalogue helps users to get a quick glance at what is available. Via CKAN, a user can then request the full dataset and is notified by email when it is available. They can then download one or more files from GoogleBigQuery. We also worked on resumable uploads. The catalogue’s data managers are now able to upload very large files to the Google Cloud through CKAN, pause the upload process and return later to resume it. ## **Link Digital: Over a decade of CKAN expertise** The client needed a vendor not just with general software development skills, but a deep, specialist expertise in CKAN’s architecture and extension development to successfully adapt the custom code. As a company with more than a decade of CKAN experience and a co-steward of the software, Link Digital showcased its deep knowledge of the software by successfully reverse-engineering and upgrading a complex integration they did not originally build, within the assigned schedule. The project is a textbook case study in the adaptability and flexibility of open source software. The fact that the client was using CKAN meant they were not locked into using a single vendor but were able to procure specialised expertise from the open market to support the customisation and evolution of their system, even though the original developers are not involved. The project was successfully delivered on time and on budget, ensuring the continuity and modernisation of a critical data platform, leaving the door open for future collaboration between Link Digital and the client. ## **Benefits of the data portal** The client’s catalogue is now on a modern, secure, and supported version of CKAN, enabling it to undertake its important work and well-positioning it for future evolution. The catalogue is now fully interoperable with global data standards such as [DCAT](https://linkdigital.com.au/news/2024/09/what-is-dcat-and-why-is-it-important-for-data-catalogs-and-open-data-portals/#:~:text=DCAT%20or%20Data%20Catalog%20Vocabulary%2C%20is%20a%20World%20Wide%20Web%20(W3C)%20recommendation%20designed%20to%20facilitate%20interoperability%20between%20data%20published%20on%20the%20web%2C%20for%20example%2C%20in%20open%20data%20catalogues%20or%20public%20facing%20data%20portals.), SDMX, WMS, and [ISO19115](https://linkdigital.com.au/news/2022/06/iso19115-geospatial-metadata-mapping-and-validation-with-ckan/). ## **CKAN: A Digital Public Good** The project showcases CKAN’s vital role as a [Digital Public Good](https://digitalpublicgoods.net/) (DPG). While CKAN has long been recognised as a powerful open-source data management system, that can facilitate the distribution of data across various sectors, in June 2023, the [Digital Public Goods Alliance](https://www.linkedin.com/company/dpgalliance/), a multi-stakeholder UN-endorsed initiative, added CKAN to its official DPG Registry. This status is granted to open-source solutions that adhere to the DPG Standard, which includes privacy best practices, doing no harm, and contributing to the UN’s Sustainable Development Goals (SDGs). The recognition of CKAN as a DPG is also associated with its use by multilateral UN organisations, as well as by philanthropic organisations and grassroots civil society movements. ## **Do you need to update your data portal?** Link Digital is ready to start a conversation with you and your team about all your open data requirements. [Contact us](https://linkdigital.com.au/get-in-touch/) and tell us about your project. **Portfolio Categories:** All case studies, Capabilities, CKAN, CKAN Migration, End to end CKAN Services, Europe, Industry, Multilateral organisations, Non-profit/NGO, Open data portal, Region, Technology Infrastructure --- ### [Columbia Basin Water Hub - Living Lakes Canada](https://linkdigital.com.au/case-studies/columbia-basin-water-hub/) **Published:** September 8, 2025 **Author:** Andrew Nette **Content:** ## **About Living Lakes Canada** [Living Lakes Canada](https://livinglakescanada.ca/) is a charitable water stewardship non-government organisation with over 20 years of experience working with community groups to protect freshwater. Their science-based programs are aligned with Canadian Provincial and Federal monitoring protocols and range from groundwater, lake, stream, and wetland monitoring to foreshore health assessments, biomonitoring for aquatic assessment and restoration, and water database development and management. They also offer water monitoring training courses to support community-based stewardship efforts across Canada and have delivered numerous educational programs targeting both youth and adults to promote water literacy and encourage a water conservation ethic. Their community-based water monitoring work originated in the Canadian Columbia Basin, the drainage basin of the Columbia River located in British Columbia, and it has expanded to include partnerships with hundreds of organisations, including industry, First Nations groups, academia, government technology and scientific consultants, water stewardship groups and other non-profit societies both nationally and internationally. [Living Lakes Canada](https://livinglakescanada.ca/) has received numerous [awards](https://livinglakescanada.ca/about-us/awards/) of note, and the organisation’s successful leadership and stewardship templates have supported the creation of other grassroots water stewardship initiatives across Canada. ![Image of the Columbia Basin Water Hub](https://linkdigital.com.au/wp-content/uploads/2023/12/Screenshot-Columbia-Basin-Waterhub-1024x604.png)[**https://data.cbwaterhub.ca/**](https://data.cbwaterhub.ca/) ## **The objectives of the hub** The [Columbia Basin Water Hub](https://data.cbwaterhub.ca/) is the open data portal developed by [Living Lakes Canada](https://livinglakescanada.ca/) for freshwater data within the Columbia Basin, in response to the need for a more coordinated water monitoring effort in the region. This need was identified in a 2017 report released by the [Columbia Basin Trust](https://ourtrust.org/) that examined the status of water monitoring and climate change in the Columbia Basin. The report highlighted significant water data gaps and the need for more coordinated monitoring as well as ‘streamlined archival and retrieval technologies’ for water data. The findings prompted [Living Lakes Canada](https://livinglakescanada.ca/) to organise and co-host a conference, [An Open Source Data Dialogue Towards a Columbia Basin Water Monitoring Framework](https://livinglakescanada.ca/resource/an-open-source-data-dialogue-towards-a-columbia-basin-water-monitoring-framework/), in late 2017. Attended by 120 water and data experts from across Canada and the northwest states, it was the catalyst for the development of both the [Columbia Basin Water Monitoring Framework](https://livinglakescanada.ca/project/columbia-basin-water-monitoring-framework/) and the [Columbia Basin Water Hub](https://data.cbwaterhub.ca/). A multitude of local community groups conduct water monitoring in the Columbia Basin but historically there was a lack of streamlined archival and retrieval technologies for the data they collected. Information was being held on private devices or kept within individual organizations, limiting collaboration, visibility, and broader application. A solution was needed to make data freely accessible and usable. [The Columbia Basin Water Hub](https://data.cbwaterhub.ca/) is designed to improve collaboration around water quantity and quality monitoring by helping the various stakeholders store, manage and share their data appropriately and effectively. ## **Partnership between Living Lakes Canada and Link Digital** [Living Lakes Canada](https://livinglakescanada.ca/) discovered [Link Digital](https://linkdigital.com.au/) through a research process, where they recognised the company’s expertise in [Comprehensive Knowledge Archive Network (CKAN)](https://ckan.org/) and chose it as the developer and partner for the [Columbia Basin Water Hub](https://data.cbwaterhub.ca/). [Living Lakes Canada](https://livinglakescanada.ca/) took on the role of project facilitator, overseeing community engagement and project planning with the active participation of five First Nations governments and the province of British Columbia. By using their expertise to bridge the communication gap between the organisations, Living Lakes Canada has ensured a more effective and efficient project. They also provided invaluable insights and documentation on engaging contributors and the ongoing management of community-based water databases. Link Digital dealt with the technical aspects of the project. This meant deploying a CKAN instance with a structure that resembled [Living Lakes Canada’s](https://livinglakescanada.ca/) existing database and incorporating customised features such as enhanced access and controls to maximise data sovereignty and adhere to [OCAP®](https://fnigc.ca/ocap-training/) (Ownership, Control, Access, Possession) principles. Link Digital’s prior experience in CKAN projects requiring advanced security and access control made it a pivotal partner for the initiative. [Link Digital](https://linkdigital.com.au/) has also been involved in ongoing support, maintenance, and customised solutions to address the unique needs of the [Columbia Basin Water Hub](https://data.cbwaterhub.ca/). ![Columbia Basin Water Hub Organization - Link Digital](https://linkdigital.com.au/wp-content/uploads/2023/12/Screenshot-Columbia-Basin-Waterhub-2-edited.png) ## **Other technical aspects of the project** 1. User Interface/User Experience Design: - The Hub’s theme is designed to ensure a cohesive and visually engaging user experience. - Data custodians can designate datasets as restricted and specify access settings, ensuring precise control over data sharing and initiating an approval workflow. - The system supports images and videos as dataset resources, enhancing the user interface and experience. - A user-friendly mechanism is in place to facilitate efficient data retrieval, and accessibility controls are implemented to promote inclusivity. 2. Metadata schemas are incorporated to enhance search facets and improve discoverability. PDF and TXT files are indexed and encompassed in search results, broadening the search functionality and making them easily discoverable. 3. User Experience Enhancement: - An optimal number of terms are configured to match search queries, guaranteeing the retrieval of the most relevant results. - The user experience is optimised to facilitate streamlined access to desired data. ## **Benefits of the Columbian Water Basin Hub** The joint efforts of [Living Lakes Canada](https://livinglakescanada.ca/) and [Link Digital](https://linkdigital.com.au/) in developing the [Columbia Water Basin Hub](https://data.cbwaterhub.ca/) serve as an inspiring example of how open data can contribute to environmental conservation and community empowerment. Additionally, the [Columbia Basin Water Hub](https://data.cbwaterhub.ca/) now hosts over 400 datasets from 50+ contributors and its functions are integrated with other databases, including the [Canadian Watershed Information Network (CanWIN)](https://canwin-datahub.ad.umanitoba.ca/fr/home) and [Pacific DataStream.](https://pacificdatastream.ca/) In doing so, the [Columbia Basin Water Hub](https://data.cbwaterhub.ca/) has facilitated greatly improved accessibility to what was once inaccessible data and has become instrumental in improved decision-making processes while showcasing the tangible impact of the greater collaboration between organisations involved in water monitoring. ![Datasets found - Columbia Basin Water Hub - Living Lakes Canada - Link Digital](https://linkdigital.com.au/wp-content/uploads/2023/12/Screenshot-Columbia-Basin-Waterhub-3-edited.png) ## **Impressions of Link Digital** “Living Lakes Canada has been impressed with Link Digital’s high standard of work and their collaborative approach to problem-solving,” said [Maggie Finkle-Aucoin](https://livinglakescanada.ca/profile/team/maggie-finkle-aucoin/), GIS and Database Manager for [Living Lakes Canada](https://livinglakescanada.ca/). “The hands-on approach by [Link Digital](https://linkdigital.com.au/) product owners has contributed to a positive working relationship.” ## **Future plans** Plans are already underway for Living Lakes Canada, including managed hosting, an Ask AI integration, and a CKAN 2.11 upgrade. Alongside this, efforts are underway to expand nationally, creating a home for community water data across the country and elevating projects of importance through greater visibility and shared access. The aim is to create a network of regional databases that function individually while serving to centralise water-related data. Another focus is improving interoperability with other organisations involved in water monitoring and the stewardship of rivers across Canada. Using the [Columbia Basin Water Hub](https://data.cbwaterhub.ca/) as a template, [Living Lakes Canada](https://livinglakescanada.ca/) can guide organisations through the process of developing similar hubs in collaboration with Link Digital to ensure smooth implementation. --- ## **Let’s build your open data portal with CKAN** Link Digital is ready to start a dialogue with you and your team on your open data needs. Contact us and [tell us about your project](https://linkdigital.com.au/get-in-touch/). **Portfolio Categories:** All case studies, Application Development, AWS, Canada, Capabilities, CKAN, End to end CKAN Services, Environmental/Climate Change, Industry, Managed Hosting, Multilateral organisations, Non-profit/NGO, Open data portal, Region, Technology Infrastructure **Portfolio Tags:** case study, living lakes canada, waterhub --- ### [CKAN-powered open data catalogue for the Inter-American Development Bank](https://linkdigital.com.au/case-studies/inter-american-development-bank-open-data-catalogue/) **Published:** March 17, 2026 **Author:** Andrew Nette **Excerpt:** Link Digital migrated IDB's proprietary open data catalogue to CKAN, handling 12 million row datasets with multilingual support across English, Spanish, Portuguese, and French, achieving full DCAT compliance. **Content:** ## Key summary ### **Impact: IDB Global Data Transformation** - **Strategic ROI:** Migrated from high-cost proprietary systems to scalable, open-source CKAN, eliminating vendor lock-in. - **Unmatched performance:** Achieved a **26x increase in processing speed** for datasets containing over 12 million rows. - **Regional reach:** Fully deployed in **4 official languages**, enabling data accessibility for 48 member countries. - **Regulatory readiness:** Guaranteed 100% **DCAT compliance** and met **WCAG 2.1 accessibility standards** for global interoperability. - **Innovation:** Link Digital’s contributions to CKAN core code future-proof the IDB’s roadmap --- ## **Organisation** [Inter-American Development Bank](https://www.iadb.org/en) ## **Context of the project** The Inter-American Development Bank (IDB) partnered with [Link Digital](https://linkdigital.com.au/) to revamp its existing open data catalogue, considerably extending its functionality to bring it into line to meet the expectations of modern data users and the challenges of the rapidly evolving open data ecosystem. A complex project successfully completed within a very tight deadline, the new open data catalogue provides advanced, multilingual search and sharing capabilities for the organisation’s open datasets. ## **Technological services provided** The project involved the following technology services: - Managed hosting. - Transition of the IDB’s existing catalogue from its proprietary software to the open source CKAN – [Comprehensive Knowledge Archive Network](https://ckan.org/). - Customisation of the CKAN instance with the IDB’s internal workflow systems through the installation of a range of CKAN extensions. - Integration of CKAN with third party software and cloud services, including [PoolParty sematic suite](https://www.poolparty.biz/knowledge-models-media-publishing) for the implementation of a controlled vocabulary to ensure datasets are consistently labelled, more discoverable, and semantically interoperable, and [Amazon Web Services S3 bucket](https://aws.amazon.com/s3/) for a scalable storage solution. - Significant hands-on work readying the IDB’s data, particularly some of their very large datasets, to be loaded into CKAN and enabling them to be easily searchable, viewable and downloadable. This included changes to CKAN’s core code to enable it to deal with datasets significantly larger in size than those the software usually handles. - Modifications to CKAN to expand its language functionality and enable all data to be displayed in the Banks’ four official languages: Spanish, English, Portuguese, and French. ![A screenshot of the IDB open data portal built by Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/09/Screenshot-2025-09-05-at-10.07.03-AM-1024x551.webp)*Screenshot of the IDB Open Data Portal* ## **Timeline and deployment** Link Digital began work on the site in October 2024 and the new catalogue went live in April 2025. The tight project turnaround was necessary because the IDB contract with the proprietary software provider managing the catalogue was ending. Link Digital is now working with the IDB on phase II of the project and providing ongoing managed hosting for the new catalogue. **Link to the site** ## **About IDB** Founded in 1959, the IDB is an international development finance institution headquartered in Washington, D.C. It is the largest provider of development financing for Latin America and the Caribbean. With 48 member countries—including 26 borrowing members from the region and 22 non-borrowing members from Asia, Europe, and North America—the IDB is dedicated to improving lives by providing financial and technical support to national and sub-national governments and institutions. The Bank also delivers policy advice, cutting-edge research, and training. Together with [IDB Invest](https://www.idbinvest.org/en), which supports the private sector, and [IDB Lab](https://bidlab.org/en), the innovation laboratory that tests and scales entrepreneurial solutions for inclusion and sustainability, the IDB Group mobilises capital, knowledge, and partnerships to address the region’s most pressing challenges and promote inclusive, sustainable development. ## **Objectives of the data catalogue** The primary objective of the new open data catalogue was to maximise the IDB’s value as a knowledge bank by generating and disseminating research and insights that help foster development in addition to increasing access to key IDB datasets and improving the sustainability, searchability and interoperability of IDB data. The project updates a previous open data catalogue, built in 2015. A major refresh and reimagining were desired to bring the catalogue in-line with modern standards and user expectations in order to meet the challenges arising from both a rapidly evolving open data ecosystem and increasing data needs from governments and institutions. ### **Other key requirements identified by the IDB included:** - A stronger and more robust data storage and retrieval system, including increased capacity to deal with some of Bank’s very large datasets. - More structured metadata and categorisation, to improve data discoverability and standardisation. - Increased language support. The previous catalogue was available in English and Spanish, but IDB required to expand this to the Bank’s other two official languages – Portuguese and French. - Optimised API architecture to improve scalability and support for larger datasets. ## **Data catalogue migration** Another major driver of the project was the strong desire to migrate the data catalogue from a proprietary to an open-source platform. The previous catalogue was built on a proprietary, closed-source system that limited scalability and customisation capabilities, unlike the new open-source solution. The conclusion of the contract with this provider offered the opportunity to make major changes. The IDB’s open data team undertook an extensive process to scope out what was required in the new catalogue. This included interviewing external and internal stakeholders, a comparison of data catalogue technology solutions used by other organisations, including their look and what features they offered, and an analysis of the various open source software technologies on offer. CKAN emerged as the option that most aligned with the IDB’s vision. The IDB’s open data team were particularly attracted by CKAN’s wide range of extensions and easy customisation, which gave them the ability to do some of the work on the catalogue themselves. It also gave the IDB flexibility to make further changes and scale the catalogue up to meet the emerging demands of data users and/or shifts in the Bank’s situation. The IDB’s open data team was also energised by the prospect of contributing to the CKAN software’s growing international community and has even [included CKAN in its open source software catalog](https://knowledge.iadb.org/en/code-development/open-source-solutions/ckan)ue. The result is an attractive, high-impact open data catalogue designed to enhance the discoverability and easy reusability of IDB datasets. It achieves this by leveraging a scalable architecture and adhering to best-practice metadata standards to ensure international interoperability with data harvesters. ## **Data catalogue specifics** The catalogue currently hosts over 200 datasets. Much of this data focuses on economic and social development, including detailed information on macroeconomic and social indicators for the Latin American and Caribbean region. Most of the data is tabular, provided in formats such as CSV, Excel spreadsheets (.xls, .xlsx), Stata files (.dta), and R data files (.rds, .RData). There are also numerous PDF documents. The data includes several extremely large datasets, which presented significant challenges for the CKAN software (discussed later). In terms of overall presentation, the new catalogue has been configured into four categories. - Datasets: Raw data, macroeconomic datasets, indicators and surveys, etc. - Datasets linked to publications: Datasets that directly support IDB research publications, provided to facilitate the validation and replication of findings. - Data portals: Dashboards and interactive stories created by the IDB to highlight trends and changes in key indicators across Latin America and the Caribbean. - Indicators: These resources are linked to the datasets and were created in response to user feedback on the previous data catalogue. Users previously had to download entire datasets and search through them to locate specific indicators. The indicators make data more discoverable by enabling users to go into the catalogue and search for a specific term or topic they are interested in, i.e., ‘unemployment’ and easily access all available data from different datasets on it. **Objective****Solution****Outcome**ScalabilityCKAN core optimisation26x Faster API ResponseInteroperabilityDCAT Metadata MappingGlobal Data HarvestingUsabilityPoolParty IntegrationReduced Data Discovery TimeInclusivityMultilingual Logic CoreExpanded Reach in LATAM/Caribbean## **Innovative features** CKAN operates as the open data catalogue’s spine, providing advanced metadata support and effective cataloguing and searching. Link Digital worked closely with the IDB open data team on several features, which all contribute to bringing the catalogue in line with global best practice. ### ***Full DCAT compliance*** The catalogue is fully [Data Catalog Vocabulary](https://www.w3.org/TR/vocab-dcat-3/) (DCAT) compliant. DCAT is an RDF vocabulary designed for describing datasets to enhance interoperability between systems that manage and expose data, such as data portals and data catalogues. It provides a standardised metadata model and vocabulary for data publishers to describe datasets and data services, enabling these systems to better exchange and integrate metadata, thereby making data more readable by a wider range of applications and, thus, more discoverable and reusable. While uptake is by no means universal, DCAT is arguably the closest thing that currently exists to a worldwide metadata standard for describing datasets in data portals and catalogues, and it is widely used by many open data portals and catalogues globally, including extensively in Latin America. The IDB’s open data team gave Link Digital an application profile based on the DCAT standard to describe their data. Link Digital then designed a data schema to accommodate this and mapped it onto CKAN’s existing internal schema, using [*ckanext-DCAT*](https://docs.ckan.org/projects/ckanext-dcat/en/latest/changelog/). This extension allows CKAN to export and publish metadata in DCAT format and enables CKAN-based data catalogues to be integrated with other data catalogues or platforms that use DCAT metadata. ### ***Controlled vocabulary*** A controlled vocabulary is a carefully selected and standardised list of terms used to consistently tag, describe, and index datasets via metadata for improved discoverability and retrieval. The IDB’s open data team uses PoolParty, a non-open-source semantic suite, to manage the controlled vocabularies they use to categorise datasets within the catalogue, which Link Digital integrated into the CKAN application. The IDB open data team were keen to introduce a predetermined list of metadata terms that those uploading data to the catalogue can use. This reduces possible confusion caused by unstructured language and variant and incorrect spellings of things like social and statistical terms, countries, etc, by ensuring that only the preferred term can be used and that it corresponds to a single subject. Having standardised themes also enables users to search for and retrieve the dataset(s) they need more easily. ### ***Automating Digital Object Identifier registration*** A Digital Object Identifier (DOI) is a unique combination of letters and numbers used to provide a permanent link to the location of an object, such as a document, image, dataset, or research paper, on the Internet, even if its URL changes. Using an extension called [*ckanext-doi*](https://github.com/NaturalHistoryMuseum/ckanext-doi), Link Digital was able to seamlessly migrate legacy DOIs to the new CKAN powered catalogue and connect it to the registration agency [DataCite](https://datacite.org/) to make the process of minting new DOIs automatic. The fact that users will always have access to the catalogue’s resources encourages openness and keeps the site aligned with the IDB’s policy of promoting persistent access to knowledge resources. The use of DataCite also makes datasets on IDB’s catalogue findable in other repositories, for example [DataCite Commons](blank), increasing their discoverability. ### ***Multilingual functionality*** The default language of the old open data catalogue was English, with some Spanish language functionality. The IDB were keen to expand this to cover all four official Bank languages: English, Spanish, French and Portuguese. While basic language support is a standard out of the box feature of CKAN, the software’s default ability in this area was limited. It did not support complete translations and did not allow users to toggle between multiple languages in the one CKAN instance. The IDB’s open data team undertook the time consuming task of translating everything on the catalogue – not just site headings and language and metadata but all the datasets as well – and Link Digital extended CKAN’s core functionality to make all the content on the site accessible in four languages and enable users to toggle between them. This removes a major barrier to data discoverability and reuse by significantly expanding the accessibility of the site to non-English speakers in Latin America and the Caribbean. ### ***Improved auditing functionality*** This is the first catalogue to use Link Digital’s new auditing functionality. Basically, every event in the catalogue is now being sent to the [Amazon CloudWatch](https://aws.amazon.com/cloudwatch/), providing Link Digital with a log of everything that occurs, which will improve maintenance and make it easier to maintain security. ## **Technical challenges** Meeting the four-month deadline for the catalogue’s completion – necessitated by the approaching end of contract with an existing software provider – was made possible by the considerable preparation undertaken by the IDB data team before Link Digital commenced work. The IDB open data team created approximately one thousand new indicators for the catalogue and did a great deal of work cleaning and restructuring the data, including aligning it for compliance with the DCAT standard. Nonetheless, the catalogue was a complex project that required considerable hands-on work and out of the box thinking on Link Digital’s part. These challenges primarily related to the size of some of the IDB’s datasets, which are far larger than those typically hosted on CKAN catalogues and open data portals. ### ***Million rows of data*** For example, the IDB’s [Social Indicators of Latin America and the Caribbean](https://data.iadb.org/dataset/social-indicators-of-latin-america-and-the-caribbean) dataset alone comprises approximately 12 million rows of data. It was very much a hands-on process to optimise code and customise indexes so that the performance of the catalogue when working with very large datasets was more than twenty times faster than the default. Accessing these large datasets using the existing CKAN architecture was challenging, as the [*ckanext-xloader*](https://github.com/ckan/ckanext-xloader) extension normally used to load them was failing. Beyond that, just having some of these datasets in the catalogue was going to present challenges for querying. The number of rows and the size of the data meant that the types of queries users were going to run could take tens of seconds to run or they would not work at all because the API would just time out. Fixing these problems required Link Digital to improve the catalogue’s API and the performance of CKAN for previewing large datasets more generally. ![Data workflow patterns](https://linkdigital.com.au/wp-content/uploads/2024/11/img-Data-workflow-patterns-blog-1024x535.jpg)*Data workflow patterns* ### ***CKAN’s Feature: New Table Designer*** Link Digital was required to do other hands-on work with the IDB’s data to get the data loaded into the CKAN site. Link Digital used the new [Table Designer](https://docs.ckan.org/en/2.11/extensions/custom-columns-constraints.html) feature for these very large datasets. This allowed the IDB to push partial updates for some of the large datasets rather than reloading the entire file, by giving them an API that allowed them to only update records that needed to be changed and added. And by maintaining that table in the database the way that Table Designer does, it allowed Link Digital to add custom indexes for the particularly large datasets. Indexes are a feature of [Postgres](https://www.postgresql.org/) that lets developers create a fast way to look up a record based on some of the filters that they have provided. Link Digital looked at the queries the IDB needed and chose combinations of columns to index for each of these datasets that has these queries run far faster. Loading the data was something that Link Digital had to help with initially because there was so much to load, but now the IDB open data team have procedures on their side to do it using the API. But creating the indexes was very much a hands-on process that Link Digital had to do directly to the Postgres DataStore database, tweaking it so that the performance would be much better than had the IDB used the default procedure. Pages on the IDB’s Open Data catalogue now load almost immediately and API calls that are part of the page when you are getting information about the dataset, which were extremely slow, have been fixed as well so they are faster. This work necessitated several changes to CKAN’s core code to optimise how the software handles very large files. These optimisations will be included in the next CKAN update, release 2.12, so that all the software’s users can benefit from them. A smaller challenge related to the IDB’s open data team wanting the functionality to prepare a whole zip file of a dataset for users to download. This could have led to potential misuse of the catalogue if several users with malicious intent opened the hit button to create a zip file at the same time, resulting in a spike in load that could have serious problems for the back end of the catalogue. To get around this, Link Digital pre-built zip files in advance and uploaded these to the Amazon cloud service for the IDB open data team to manage the download. If there is no change to the dataset once it is compiled and uploaded to the catalogue, the pre-built zip file remains on the site and can be easily downloaded. Data migration from the old open data catalogue was also tricky and took a considerable amount of time because of the number of datasets. ## **The benefits of the IDB portal** Despite being relatively new, the catalogue is already showing positive impact, with several Latin American governments expressing interest in the platform and exploring ways to make use of it. The IDB’s open data team has also found the workflow process involved in publishing new datasets to the catalogue is easier and has far less friction. The introduction of controlled vocabulary is proving particularly helpful. The publishing process will continue to improve as the IDB data team finalises work on their new internal publishing workflow. The CKAN community also benefits and here are some of the core CKAN contributions that came directly from work on IDB open data: - : makes the table preview of some of the largest datasets on IDB open data load 26x faster - : makes the table previews an additional 3x faster - : makes a common API call 24x faster for some of the largest datasets on the IDB open data catalogue, including when users view the dataset page. ## **Future plans** Link Digital is already working with IDB on phase 2 of the project to continue expanding the benefits of the solution. This includes: - Further improving API response times. - Search engine optimisation for mobile devices. - Work to enhance the catalogue’s user interface. The user interface design will continue to evolve based on user feedback collected since the catalogue went live. This includes the addition of some pages in [HTMX](https://docs.ckan.org/en/latest/theming/htmx.html). A new feature in CKAN, HTMX is an open-source front-end JavaScript library that allows developers to create a faster and more interactive UI experience. The implementation of additional accessibility features to bring the catalogue fully into line with [Web Content Accessibility Guidelines (WCAG) 2.1](https://www.w3.org/TR/WCAG21/). **Portfolio Categories:** All case studies, AWS, Capabilities, CKAN, CKAN Migration, End to end CKAN Services, Environmental/Climate Change, Government/Public Sector, Higher Education/Research, Managed Hosting, Multilateral organisations, Open data portal, Region, South America **Portfolio Tags:** open data portal --- ### [Vehicle Emission Star Rating on Drupal](https://linkdigital.com.au/case-studies/vehicle-emission-star-rating/) **Published:** August 14, 2024 **Author:** Andrew Nette **Excerpt:** The results show that the higher the star rating, the lower the annual fuel cost. Read the technical aspects and Link Digital’s role on the VESR website. **Content:** *This case study was published in August 2024*. ## **About VESR** The [Vehicle Emissions Star Rating (VESR) website](https://www.vesr.gov.au/) was initiated by the New South Wales Government and is administered by the Net Zero team. The Net Zero team is responsible for delivering on reducing emissions in the transport sector, which is part of the NSW Government’s plan to reach Net Zero by 2030. VESR was launched in March 2024, in collaboration with the Commonwealth and endorsed by all Australian state and territory governments. [Link Digital](https://linkdigital.com.au/) was one of a consortium of developers that worked on the project. ![Screenshot of the VESR website with Drupal - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/08/www.vesr_.gov_.au_browse-1-1024x804.png) ## **Objectives of the VESR** **project** The VESR website has been designed to assist Australian consumers to factor in the environmental impact when planning their next vehicle purchase. It does this by using a simple star rating enabling them to compare the carbon dioxide (CO2) tailpipe emissions of over 16,000 passenger vehicles since 2004 that are 3.5 tonnes or less across petrol, diesel, hybrid, plug-in hybrid and fully electric engine types. Manufacturers are legally required to provide the Commonwealth Government with emission and fuel consumption data for any vehicle sold in Australia. This information, based on laboratory tests that comply with specific Australian design rules, includes a standard test that measures the amount of CO2 released from a tailpipe per kilometre driven. This information is made available in the Australian Government’s [Green Vehicle Guide](https://www.greenvehicleguide.gov.au/). Information on fuel efficiency and CO2 emissions is also provided via a government mandated fuel consumption label that is applied to all vehicles sold in Australia. What the VESR website does, that the Green Vehicle Guide and fuel consumption labels do not, is enable consumers to have a simple star rating, to view and compare the environmental impact of up to four vehicles at the same time. The Green Vehicle Guide also lacks the ability for people to view vehicle images, which can make it difficult if a consumer does not know what vehicle they are looking for. The VESR website makes this existing information more accessible and easier to understand by utilising a straightforward star rating, like that used for some time now to measure the environmental impact of household appliances. All vehicles are rated up to six stars, in half star increments, based on the vehicle’s tailpipe emissions, with six stars representing no tailpipe emissions. The website also enables users to add their estimated kilometres of travel and cost of petrol, diesel and/or electricity, to calculate an estimated yearly average fuel cost for their vehicle. The results in VESR show that the higher the star rating, the lower the annual fuel cost which reflects a more efficient vehicle. ## **Technical aspects and Link Digital’s role in the VESR website** Link Digital was one of several vendors involved in the creation of the VESR website. We did the development build using [Drupal](https://www.drupal.org/), an open source content management system for making websites and web applications. This enabled us to present all the data in a simple, easy to use, and visually appealing format. The build was based on a design template for the site and the star rating done by another vendor, [mov3ment](https://mov3ment.com.au/), which we configured to enable the data to appear for each vehicle. This involved harvesting data not only from the Green Vehicle Guide, but a vehicle database known as [GLASS](https://www.glassguide.com.au/), which provided the vehicle images, to make VESR much more user friendly. The Application Programming Interface is used to pull data from both data points, including regularly scheduled updates in terms of new vehicles, etc. ## **Benefits** According to the [Commonwealth Scientific and Industrial Research Organisation](https://www.csiro.au/en/), transport is Australia’s third largest source of CO2 emissions, of which light vehicles are a major contributor.[\[i\]](#_edn1) The VESR system is a great example of data being used to enable consumers to measure vehicular tailpipe emissions and factor this into their purchase plans. This will, hopefully, deliver tangible results by helping drive down light vehicle emissions. As well as calculating vehicle tailpipes CO2 emissions, the VESR website enables consumers to calculate the annual running cost of both petrol and electric vehicles, based on fuel price, model and annual travel distance. The site contains information developed by the Net Zero team, in consultation with experts, on issues such as understanding vehicle emissions, and the life cycle of emissions and how to reduce them. It also provides useful information for drivers of electric vehicles, such as locations of battery charging infrastructure and battery recycling. ![VESR comparison vehicles - Drupal, Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/08/www.vesr_.gov_.au_compare-1024x804.png) ## **Future plans** The VESR website was only launched in March 2024, and the Net Zero team is planning on undertaking an awareness campaign to help more consumers understand how the site can be of value and to further encourage its use. The team are monitoring movements in Australia’s light car market with a view to keeping the site constantly updated. There are also plans to update the site with other vehicle types, such as LPG, given user feedback that has been received to date. The [Australian Automobile Association](https://www.aaa.asn.au/), the peak association for Australian motoring clubs, is currently undertaking [a testing program of approximately two hundred vehicles, to identify how real world driving conditions compare to the lab tested results that inform the Green Vehicle Guide](https://www.infrastructure.gov.au/infrastructure-transport-vehicles/vehicles/vehicle-safety-environment/questions-and-answers-real-world-testing-vehicle-efficiency). According to Suzana Barbir, Net Zero team Program Officer, in [a presentation to a Link Digital Public Forum](https://www.youtube.com/watch?v=8Ap0AF-QMUc) in April 2024, they are monitoring these results with a view to seeing how they might be incorporated in a future iteration of the site. **Do you have a data project that you need assistance with?** [Link Digital](https://linkdigital.com.au/) is ready to start a dialogue with you and your team on your open data needs. [Contact us and tell us about your project](https://linkdigital.com.au/get-in-touch/). --- [\[i\]](#_ednref1) Commonwealth Scientific and Industrial research Organisation, *Pathways to Net Zero Emissions – An Australian Perspective on Rapid Decarbonisation*, November 2023, **Portfolio Categories:** All case studies, Application Development, Australia and New Zealand, Capabilities, Drupal, Environmental/Climate Change, Government/Public Sector, Industry, Region, Technology Infrastructure --- ### [Internal Data Portal on CKAN - Information Asset Register for the NSW Departments](https://linkdigital.com.au/case-studies/information-asset-register-new-south-wales/) **Published:** October 4, 2024 **Author:** Andrew Nette **Content:** *This case study was published in October 2024.* ## **About the project** An information asset register (IAR) is a catalogue which registers data assets held by an organisation and helps manage access to those data assets. Link Digital started working on a corporate IAR for the New South Wales Office of Environment and Heritage in 2015, and the application was rolled out in 2016. The IAR now services two NSW state government departments: [Department of Planning Housing and Infrastructure](https://www.nsw.gov.au/departments-and-agencies/department-of-planning-housing-and-infrastructure) (DPHI) and [Department of Climate Change, Energy, the Environment and Water](https://www.nsw.gov.au/departments-and-agencies/dcceew) (DCCEEW). ![Screenshot of Information Asset Register of the New South Wales Government.](https://linkdigital.com.au/wp-content/uploads/2024/10/SS-NSW-IAR.jpg)***NSW’s IAR homepage*** ## **Objectives of the IAR** The key aim of the IAR was to aid compliance with the [NSW Government’s Open Data Policy](https://data.nsw.gov.au/nsw-government-open-data-policy). The policy seeks to embed open data in day-to-day government operations, including making data public for use by the community, researchers, business, etc, and for government staff to use it ‘to inform the design of policy, programs and procurement.’ The Office of Environment and Heritage wanted to develop an application that could make data accessible and available to users with accompanying metadata and data quality statements, to support the management of data and information resources as “assets” which can be used, reused and shared. ![NSW Government's Open Data Policy](https://linkdigital.com.au/wp-content/uploads/2024/10/image-1024x207.png)NSW Government’s Open Data Policy: The IAR was developed as a catalogue and retrieval system (not a data storage system). Staff use the IAR to register information assets from their business areas (e.g. datasets,databases, business applications, modelling tools, reports; whatever the business area thinks might be of use to others); with links for asset access and retrieval. Whilst files may be uploaded to the IAR for ease of retrieval, these are copies of master data stored elsewhere in corporate repositories. Once registered, information assets are discoverable by other staff across the department. The IAR replaced a pre-existing metadata portal for spatial data only. This was revamped using CKAN – [the Comprehensive Knowledge Archive Network](https://ckan.org/) – open source software that can be configured and set up to function as a data platform once it is deployed and hosted on a web server. Approximately two thirds of the IAR’s records are published to the NSW [Sharing and Enabling Environmental Data portal](https://www.seed.nsw.gov.au/). A subset of IAR records is also published to the NSW [Planning portal](https://www.planningportal.nsw.gov.au/opendata/dataset/). All published records are syndicated to [data.nsw](https://data.nsw.gov.au/).gov.au, the NSW Government’s central open data platform, which is in turn harvested by Australia’s [national data portal](http://data.gov.au./). All these portals use CKAN, which facilitates seamless interoperability between them. ## **Who can create records in the IAR?** One of CKAN’s strengths as an [internal data management platform](https://linkdigital.com.au/services/internal-data-management-with-ckan/) is the ability to set predefined group and individual permissions to control the flow of critical internal data. In the IAR, these permissions work on three levels: - Any member of staff can use the IAR to search for data assets. - Any member of staff can apply for IAR edit access. An editor can register data assets from their business area for wider internal discovery. Each data asset is registered with: - Mandatory governance information, including details of the data’s classification, source storage system, its Data Asset Custodian and Data Asset Steward - Metadata statement - A data quality statement - Approval for publication is the responsibility of the Data Asset Steward. This is usually a manager in the business area concerned, who has proper delegation under the [*Government Information (Public Access) Act 2009*](https://www.legislation.nsw.gov.au/view/html/inforce/current/act-2009-052). Approval is via email to the corporate Data Broker automated via a pre-existing email template in the IAR. The corporate Data Broker publishes the data asset upon receiving approval from the designated Data Asset Steward. ## **Link Digital’s role and technical challenges** In addition to developing the IAR’s information governance module, which records mandatory governance information about each registered data asset, Link Digital developed a metadata module with a range of templates. The templates for geospatial data were made compliant with the current approved standard [AS/NZS ISO 19115.1:2015](https://www.anzlic.gov.au/resources/asnzs-iso-1911512015-metadata), as recommended for use by [ANZLIC – the Spatial Information Council](https://www.anzlic.gov.au/), the peak intergovernmental organisation for the collection, management and use of spatial information in Australia and New Zealand. ![Common User Task Flow (Internal data management diagram by Link Digital)](https://linkdigital.com.au/wp-content/uploads/2024/10/Diagram-2-1024x1024.png)***Common User Task Flow (Internal data management diagram by Link Digital)*** Additionally, Link Digital developed an inbuilt validator in the IAR to confirm ISO19115 compliance. The validator takes Extensible Markup Language (XML) – the markup language that provides rules to define any data – as an input and checks whether it adheres to the latest standard based on the most up-to-date guidelines for this standard. This required Link Digital to infer requirements and implement a validator directly from the standard’s specification. Complexity within the standard required a careful observance to conditional elements and nested structures. This task would have been very difficult without the use of the [ckanext-scheming extension](https://github.com/ckan/ckanext-scheming), which has strong support for nested structures. Link Digital also implemented functionality for the IAR to mint **[Digital Object Identifiers (DOIs)](https://linkdigital.com.au/news/2020/08/ckan-and-digital-object-identifiers-dois/)** for selected data assets upon publication. A DOI is a unique combination of letters and numbers that are used to provide a permanent link to the location of an object, such as a document, image, dataset, or research paper, on the internet, even if its URL changes. This is particularly useful for grey literature, i.e., material not published in peer reviewed academic journals. DPHI belongs to a consortium of organisations, coordinated by the [Australian Research Data Commons](https://ardc.edu.au/), which have DOI minting capabilities provided by DataCite. Link Digital provided a technical solution by which a DOI can be minted for both DPHI and DCCEEW via the IAR at the time of data asset publication to the SEED portal. Link Digital also hosts the IAR and helps with its day-to-day maintenance on an ongoing basis. ## **Benefits of the IAR** In summary, the IAR acts as an information catalogue for departmental staff, enabling them to discover, re-use and, where appropriate, publish data assets. The IAR underpins the departments’ open data eco system, enabling compliance with the requirements of the state’s open data policies and publish information with metadata and data quality statements. ## **Building your information asset register?** [Get in touch](https://linkdigital.com.au/get-in-touch/) and one of our CKAN experts will reach out. **Portfolio Categories:** All case studies, Australia and New Zealand, AWS, Capabilities, CKAN, Environmental/Climate Change, Government/Public Sector, Industry, Internal data hub, Managed Hosting, Region --- ### [Case study: Sharing and Enabling Environment Data Portal (SEED) for New South Wales Government](https://linkdigital.com.au/case-studies/sharing-and-enabling-environment-data-portal/) **Published:** November 4, 2024 **Author:** Andrew Nette **Content:** ## **About the project** [The Sharing and Enabling Environmental Data portal (SEED](https://www.seed.nsw.gov.au/)) was launched in 2016 to provide a centralised place where the community, industry, consultants, NGO’s, researchers and government can come to search for, access, contribute and share NSW environmental data. All of SEED’s data is publicly accessible, adhering to best practice governance and metadata standards, and championing [NSW Government’s Open Data Policy](https://data.nsw.gov.au/nsw-government-open-data-policy). Providing a single, accessible and reliable point for sharing quality, integrated environmental data has built trust in, and enabled better evidence-informed research, and decision making, ultimately contributing to positive environmental outcomes. ![SEED Data Portal](https://linkdigital.com.au/wp-content/uploads/2024/11/image-1024x608.png)*SEED Portal homepage* Since its establishment, the SEED portal has always been evolving to meet the increasing demand for comprehensive environmental data to effectively facilitate transparent decision making. Interactive dashboards, linking data to research, reports and strategies, and providing additional information on its spatial data, were added to SEED a couple of years ago. Most recently, it added a multi-hub service with the launch of several integrated themed hub environments. The SEED hubs take the site’s functionality to the next level, enabling it to provide a service where the experts create their own dedicated space to engage with their users and stakeholders around themes of data available on SEED. Through this service, communities create their own powerful and fit-for-purpose insights. The first of these, the [Water Hub](https://water-hub.seed.nsw.gov.au/), went live in 2023. This is designed to offer ‘a space for the community to explore information and engage with one another regarding water datasets,’ and is administered by [NSW Department of Climate Change, Energy, the Environment and Water](https://www.nsw.gov.au/departments-and-agencies/dcceew) (DCCEEW). ![New South Wales Water Hub](https://linkdigital.com.au/wp-content/uploads/2024/11/image-2-1024x608.png)*NSW Water Hub* Four additional Hubs have been introduced since then. The [Air Quality Hub](https://airquality-hub.seed.nsw.gov.au/) contains data regarding air quality monitoring in NSW and is administered by DCCEEW’s Climate & Atmospheric Branch in collaboration with [The Operational Network of Air Quality Impact Resources](https://openair.org.au/wp/#:~:text=The%20Operational%20Network%20of%20Air,low%2Dcost%20air%20quality%20sensors.). The [Imagery Hub](https://imagery-hub.seed.nsw.gov.au/) is a centralised repository for a wide range of satellite imagery for NSW. The [Natural Capital Accounting Hub](https://nca-hub.seed.nsw.gov.au/) is a space to explore and engage with information relating to natural capital accounting, a framework for integrating economic and environment data to develop improved insights into environmental assets and ecosystem shifts. It is administered by DCCEEW’s Natural Capital Markets and Accounts team. [The Natural Hazard Science Hub](https://naturalhazardsscience-hub.seed.nsw.gov.au/) presents science and monitoring of the impact of natural hazards, to build a deeper understanding of the science behind these events and inform evidence-based policy and management decisions. It is administered by DCCEEW. ![Screenshot of the NSW SEED Map of the Air Quality Hub - Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/11/image-3-1024x608.png)*SEED Map of the Air Quality Hub* ## **Objectives of the multisite portal** SEED was always envisioned as a place for discovering and sharing environmental data to enhance public knowledge, policy and research development, and decision-making. While users engaged in discussions about specific data topics outside of SEED, there was no central space within SEED for people to have conversations that were important to them and to provide feedback on subject based environmental datasets. The hubs enable SEED to provide a cost-effective and lightweight service that is available to organisations wanting to engage with their customers and stakeholders around themes of data, available on SEED. The infrastructure is designed to be flexible and scalable, making it adaptable and responsive to customer and stakeholder needs. This includes sharing data insights and discussing data by creating threads about specific datasets. While each of the hubs may have a different key audience, the information available on all of them is aimed at engaging as broad a community as possible. In addition to members of the public, this includes industry, academics, national, state and local government employees, and not for profit agencies. ## **Link Digital’s role** SEED commissioned Link Digital in early 2023 to adapt the then Citizen Science Infrastructure Hub into a multi-hub portal using a single code base. The redesigned identity was launched in 2023. In cooperation with the SEED team, the Link Digital team worked to integrate the new hubs with the existing [CKAN (Comprehensive Knowledge Archive Network)](https://ckan.org/) instance, which is in the SEED portal. Link Digital improved the accessibility features to ensure users can more easily browse the data they need and used Drupal, a free and open-source content management system suitable for developing web applications, to create a slicker, fresher look. ## **How does the SEED hub service work?** The hubs are integrated into the main SEED portal via the datasets. SEED currently hosts over 6,000 datasets, and a hub presents a curated subset of these datasets applicable to the theme of each hub. When a hub connects to SEED, it pulls just enough information to give the user a preview of the metadata associated with a dataset so they can make the connection between the dataset relating to the page content, usually a case study. If the user wants to explore further, they are taken into the main SEED platform, where the datasets are located. All datasets on the hubs are freely available and users can access them without the need to create an account and log in. However, if a user does choose to create a profile on the site or, in other words, register and become an authenticated user, they can access greater functionality. ## **Benefits** The hubs provide a single point of truth for the dissemination of high quality, standardised and best-practice data governance. They also provide an avenue for data to become ‘open by design’ rather than ‘open by default’. Data that is open by design considers the end user through the data cycle, ensuring that data is continuously improved to better support decision making. This encourages government transparency, empowers the public, and supports greater collaboration between data users, data providers, the government and other stakeholders. Using the same basic code base across the multiple hubs keeps maintenance simple and means that additional hubs can be added with minimal effort. This enables the multi-site portal to easily evolve and adapt to changing data needs on the part of the government and external users, i.e., developing new data hubs to meet emerging groups of interest or major issues of concern. The SEED hub service is an innovative solution which moves beyond the basic functionality of open data portals. It delivers greater interactivity, including enabling users to contribute insights and engage in real-time discussion about data, while addressing fundamental challenges for government around data management, such as how data can be better catalogued and made more discoverable and shareable more widely. If you would like to find out more about SEED or the hubs, please contact the SEED team on ## **Building a data portal?** [Get in touch](https://linkdigital.com.au/get-in-touch/) and one of our CKAN experts will reach out. **Portfolio Categories:** All case studies, Australia and New Zealand, Capabilities, CKAN, Drupal, Environmental/Climate Change, Government/Public Sector, Internal data hub, Managed Hosting, Open data portal, Region, Technology Infrastructure --- ### [Case study: New Zealand's Ministry of Business Innovation and Employment (MBIE) - Resources Markets Branch](https://linkdigital.com.au/case-studies/data-governance-geoscience-regulation-agency-leveraged-ckan/) **Published:** April 2, 2025 **Author:** Andrew Nette **Excerpt:** This online data storage platform was launched in 2023. The open data portal currently hosts close to 60,000 datasets. Read more about its data governance. **Content:** *This case study was published in 2024.* ## **The client** The Resources Markets Branch of New Zealand’s Ministry of Business Innovation and Employment ## **Technology infrastructure** CKAN, Azure, Solr, geospatial tools such as ArcGIS and FME Workbench ## **Project period** 2020 – Mid 2023, with ongoing support ## **Services provided** - Installation of two interconnected CKAN portals: an internal geoscience data asset register and a public-facing open data portal - CKAN customisation with client’s internal data pipeline and workflow systems - Data migration from legacy infrastructure to new CKAN instances ## **Public geodata catalogue** ![MBIE's geodata catalogue built and supported by Link Digital](https://linkdigital.com.au/wp-content/uploads/2025/04/image-1024x528.png)*Homepage of MBIE’s public geodata catalogue* ## **Context and objectives of the data portal project** The[ Resources Markets Branch](https://www.mbie.govt.nz/building-and-energy/energy-and-natural-resources/) of New Zealand’s [Ministry of Business, Innovation and Employment’s](https://www.mbie.govt.nz/) (MBIE) is the country’s regulatory steward for resources market systems. Through its regulatory activities under New Zealand’s resources legislation, MBIE has responsibility for the collection and management of petabytes of geoscience data, including that gathered under mandatory industry reporting. This includes: - Maps - Field seismic data - A Mine Plan Database - Survey data, including physical core samples - Data and documents relating to royalties, fees and permits - The Petroleum Production, Reserves and Resources Database - Documents and correspondence relating to policy, project and regulatory servicing and compliance - Spatial information to support working with Māori, stakeholder engagement, policy, project and regulatory servicing This data is stored and managed in a variety of different formats: tabular data, PDF reports and document archives, imagery & geospatial data, partitioned data sets, and specialized mining and petroleum-related data in geospatial and geodata formats. MBIE required a replacement for their existing online data storage platform, which was nearing the end of its support lifecycle. This existing data setup included an internal data catalogue and a public-facing data portal. The client felt strongly that the existing software components and operational and database management systems were not meeting the rapidly changing needs of users and stakeholders. MBIE was data rich but found it difficult to make connections and gain insights from the data in its possession. In addition, the existing setup was operated with an end-of-life proprietary software, which they found provided far more functionality than was needed. There was also a strong desire to adopt open source technology solutions (the license under which the previous system worked was operated by a private sector provider using proprietary software) and cloud solutions. This was in line with the New Zealand Government’s drive to improve the discovery and reuse of its open data, and its support for the [FAIR principles](https://www.go-fair.org/fair-principles/) of Findability, Accessibility, Interoperability, and Reuse of digital data. ## **Scoping the project** In the initial stages of the market analysis to replace its existing online data storage set up, MBIE became aware of work undertaken by Link Digital on [Geological Survey of Queensland](https://www.business.qld.gov.au/industries/mining-energy-water/resources/geoscience-information/gsq) (GSQ)’s [public facing geoscience open data portal](https://geoscience.data.qld.gov.au/). GSQ is the state’s custodian of mineral and energy resources data, including that gathered via mandatory industry reporting. The Queensland portal was a smaller, less complex version of what MBIE was trying to achieve, and they liked its clean, modern interface and focus on information discovery and access. Taking the Queensland portal as a starting point but adding a range of significant customised features, the client wanted both a revamped internal and a new public-facing open data portal, both using CKAN implementations and connected so that data can be transferred between the two. The agency also wanted the portals to be scalable so that they could continue to be enhanced in the successive phases. Link Digital took part in several online workshops to understand the client’s needs and help them scope out workable solutions and the work required to achieve these. ## **Technical challenges** Link Digital was one of three vendors contracted to work as a consortium on the project but the only vendor working on the CKAN aspects. It represents one of Link Digital’s most complex open data implementations. The development process was complicated, with multiple stakeholders and the need to formulate a method to test and integrate all the contributions across the different vendors. And MBIE was very concerned about data security during the build phase and we and other vendors had only restricted access to their system, which also presented challenges. The project involved replacing MBIE’s existing online data storage platform with two interconnected CKAN implementations: an internal data geodata catalogue and a public-facing open data portal. These implementations were connected to data ingestion via the [CKAN API (](https://docs.ckan.org/en/2.9/api/)application programming interface). ## **Technical integration with MBIE’s data pipeline** The project involved a complex technical process of integrating the CKAN instances with multiple systems involved in MBIE’s data pipeline and workflow processes. MBIE works under a complex and strictly legislated set of processes for the collection, processing and publication of data. After being collected, data is processed, including the population of metadata, and uploaded into the internal data portal. Once several conditions have been met, some of this data is then uploaded into the public portal. This process must be undertaken within strict deadlines set by legislation, which includes an embargo period under which data provided by commercial entities remains private before being made public. MBIE’s existing data pipeline was migrated to FME Workbench, and its workflow processes were undertaken within Jira. The latter included a ticketing system for the various stages of the data’s journey to publication and any updates or modifications that are made to the status of a published data set. Link Digital configured and improved the new setup to integrate the CKAN instances with MBIE’s existing processes so that they did not have to be implemented again from scratch. In addition to Jira and FME Workbench, the CKAN instances had to be integrated to work with various other systems, including: - Azure cloud infrastructure and Active Directory SSO that allows users to conveniently log into web-based software applications. - RealMe, the New Zealand Government’s national digital ID platform. - Solr, an open-source enterprise-search platform. - Geospatial tools like ArcGIS and FME Workbench, both of which are used to enable the presentation of data in map form and connect written data with specific geographical locations, as well as linking this with an application for browsing, visualising and analysing a diverse suite of curated national and regional geoscience data sets. ## **Data migration** Link Digital oversaw data migration from MBIE’s legacy infrastructure to the new CKAN system. This was a major task given the large amount of data involved and the need to migrate it without problems, with some migration work continuing even after launch. In addition to developing a data schema and process for the migration, Link Digital created a staging location for the data on route to it being ingested by the CKAN system using Azure Blob Storage. This saved time and cost and made the process considerably less complex by enabling the client to upload and temporarily store the large amount of data on the same cloud storage server as they were currently using, on route to migration to the new CKAN system. ## **Benefits and future plans** The new online data storage platform was launched in 2023, with Link Digital providing ongoing support and maintenance. This included, most recently, upgrading the setup to the latest version of CKAN. The client has noted definite improvements with the new system, including evidence data users previously found hard to find is now easily discoverable. The public-facing data portal alone currently hosts over 60,000 datasets. MBIE has plans to use the new setup to expose a very large quantity of offline seismic field data, which were previously stored on magnetic tape. These data resources will remain ‘offline’ in cloud cold storage, but the datasets will be discoverable in the public-facing open data catalogue. The data will then be able to be requested from within the catalogue, with delivery via Azure download or physical media. ## **Building a similar project?** [Contact the Link Digital open data portal experts](https://linkdigital.com.au/get-in-touch/). - [Facebook](https://facebook.com/LinkDigital%20) - [YouTube](https://youtube.com/@link-digital) - [LinkedIn](https://www.linkedin.com/company/link-digital/) [**Subscribe to Link Digital’s newsletter**](http://linkdigital.com.au/newsletter) **Portfolio Categories:** All case studies, Australia and New Zealand, AWS, Azure, Capabilities, CKAN, Environmental/Climate Change, Government/Public Sector, Industry, Managed Hosting, Product Development, Region, Technology Infrastructure --- ### [Pacific Data Hub - The Pacific Community](https://linkdigital.com.au/case-studies/pacific-data-hub/) **Published:** June 4, 2025 **Author:** Steven De Costa **Excerpt:** Link Digital has worked with SPC on the re-indexing of datasets to align with topics and categories of particular importance to the Pacific, thus improving its ability to assist with evidence-informed research, policy, and planning, and recently upgraded the site to CKAN 2.11. **Content:** *This case study was published in 2024.* ## **About the Pacific Community** [The Pacific Community (SPC)](https://www.spc.int/) is the principal scientific and technical organisation supporting development in the Pacific region. Created in 1947, its 27 members are the 22 Pacific nations and territories and their five metropolitan partners: Australia, the United States, France, the United Kingdom, and New Zealand. The SPC’s core areas of work include fisheries, public health and education, good governance, trade, disaster management, employment and education, and cross-cutting issues such as human rights, food systems, gender equality, and environmental sustainability and climate change. ![Pacific Data Hub partnered with Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/12/image-1024x654.png)*Home page of the Pacific Data Hub website* Amongst its other important functions, the SPC is mandated by its members to provide leadership in data and statistics. The SPC is the custodian of over seven decades of Pacific-related data, including population census, household survey, and geospatial data. It works to make this easily available to government decision-makers and related Pacific civil society and business organisations, who require it for evidence-based research and policy-making. This critical work includes enabling Pacific states to undertake the compilation, updating, and dissemination of the Pacific Sustainable Development Indicators, which, in turn, assist countries in meeting their reporting requirements in relation to the [United Nations Sustainable Development Goals](https://sdgs.un.org/goals) (SDG). The SDGs create significant statistical challenges for Pacific states, particularly the smaller ones, which do not otherwise have the capacity to undertake the necessary data collection. ## **Pacific Data Hub objectives** [Pacific Data Hub](https://pacificdata.org/) is an open data portal that serves as a gateway to the most comprehensive data collection of relevance to the 22 Pacific Island nations. In addition to Pacific states, the Hub also pulls in related data from SPC’s metropolitan members and the organisations such as the [World Bank](https://www.worldbank.org/en/home), the [United Nations](https://www.un.org/en/), and the [Organisation for Economic Cooperation and Development](https://www.oecd.org/). The Hub is the SPC’s answer to the challenges and opportunities it faces as a data steward for the Pacific region. According to Sioeli Tonga, the SPC’s program manager, the Hub’s inception arose in response to the following questions: How do we ensure that the data under our stewardship is protected, shared responsibly, and utilised ethically? And how do we ensure that it continues to be accessible beyond project funding horizons? And, also, how do we ensure that data can be used to inform policy developments and decision-making that results in positive outcomes for Pacific people? Prior to the Hub, there was no regional digital infrastructure for the long-term storage and use of data amassed by SPC. Pacific-related data and statistics were difficult to locate, fragmented, incomplete, and held by various stakeholders in multiple formats across numerous geographic and administrative locations. This inhibited the ability of government, researchers, civil society organisations, and business to obtain insights from the region’s data sources and share and reuse data. The Hub acts as a digital platform on which any government, donor, academic, or member of the community can both store and access high-quality, reliable, up-to-date data. It is a sustainable digital public good and open data infrastructure for member states, many of whom lack the resources to establish and maintain one on their own; one that goes beyond the shorter funding horizons of most development assistance programs and aid projects. In this way the Hub also seeks to contribute towards: - Providing timely, high-quality data to enable better policy-making and the creation of more informed and ‘Pacific-centric’ solutions. - Strengthening data collection and data governance and management practices throughout the region. - Building partnerships to enhance coordination, strengthen capacity, and improve data literacy. The Hub also plays a crucial function in building trust in the role of the SPC and its members as data stewards. In Tonga’s words, the Hub ‘provides a governance framework that ensures that the data assets under our care can be used and reused to not only maximise value and impact but also to ensure that the data is used responsibly and ethically.’ ## **Pacific Data Hub functionality** The Hub seamlessly combines [CKAN—the Comprehensive Knowledge Archive Network](https://linkdigital.com.au/ckan-and-open-data/) – with Drupal – a free and open-source web content management system—into an open data platform solution that is both attractive and highly functional. This includes being fully usable for desktop, mobile, and tablet devices. Data can be searched by country or subject and presented in different ways, including: - CSV, spreadsheets, JSON - As charts, graphs, and diagrams - Geospatially in map forms within the CKAN catalogue using [PacificMap](https://map.pacificdata.org/) ![Pacific Map by the Pacific Data Hub, a client of Link Digital](https://linkdigital.com.au/wp-content/uploads/2024/12/image-1-1024x553.png)*Home page of the Pacific Map* ![Country data - Pacific Data Hub](https://linkdigital.com.au/wp-content/uploads/2019/01/image-1024x615.png)*Data can be searched by country* The Hub has the capacity to store data via the CKAN data catalogue. This includes material for which the external source links may not be available or are unstable or temporary. The Hub can also take users to external sites and data repositories. It utilises a variety of harvesters to pull data on a regular basis from external sources. If the external portal or data catalogue has an application programming interface or web service, the Hub can link to it and enable smooth, simple access to datasets by end users. The Hub took Link Digital two years to mature, from conception to approval of proof of concept and to gathering a critical mass of data, features, and context into the catalogue. The technical aspects of the project were complex, not only pulling in and presenting data collected over seven decades and stored in different tools and platforms, but also data held by other organisations stored in their own individual platforms and systems. It underscores Link Digital’s expertise in successfully helping SPC to bring together a deep ecosystem of open source technical elements related to open data dissemination in one comprehensive portal design. Link Digital assisted SPC with the broader complexities involved in sourcing and organising data sets from across multiple geographic and administrative jurisdictions while factoring in linguistic and cultural considerations and questions of data sovereignty and where the data is stored. An important part of the challenges involved in this was establishing the trust of stakeholders, in other words, obtaining the social license. As Tonga puts it: > > > That initial step of developing a prototype that we could use to demonstrate value quickly was really important. This got us the buy-in we needed to continue the journey. I can’t stress enough how important that partnership with Link Digital for us was to make that happen, because we certainly did not have the capacity or capability internally to do that ourselves quickly. Since it was established in late 2020, Link Digital has collaborated with SPC on improvements to the Hub’s functionality. This includes building a dashboard that functions as a regional dissemination platform for monitoring the Pacific region’s progress towards meeting the UN SDGs. [This is one of ten topic-specific dashboards hosted by the Hub, which can be viewed here](https://pacificdata.org/dashboards), which nearly all use Hub data hosted on CKAN as their source. Link Digital has also worked with SPC on the re-indexing of datasets to align with topics and categories of particular importance to the Pacific, thus improving its ability to assist with evidence-informed research, policy, and planning, and recently upgraded the site to CKAN 2.11. ## **Benefits of the Pacific Data Hub** The Hub demonstrates how data management platforms based on open source technology such as CKAN have the potential to provide real-world benefits over the long term as digital public infrastructure. The Hub plays a vital role in supporting evidence-based research and more informed policy development on the part of Pacific stakeholders through: - Improved data discovery by helping to streamline and increase data publishing, discovery, sharing, and re-usage. - Improved data quality. - Improved collaboration by empowering researchers working on similar projects or topics to connect and share resources. Examples that clearly demonstrate the Hub’s impact include: *Improving census data and its use and re-use* The Hub’s [Microdata Library](https://microdata.pacificdata.org/index.php/home) has become a central repository of the Pacific region’s survey, census, and administrative-based microdata, metadata, and documentation. A free service, populated and maintained by the SPC’s Statistics and Development Division, it allows users to search, access, and download a wide variety of quality data, organised in compliance with international standards. The Microdata Library has led to significant advancements in the standardisation of census and survey methodologies and instruments by Pacific Island governments, including the adoption of clear and transparent legal and data governance frameworks and utilised tools to reduce statistical disclosure risk. *Improving data on sustainable food systems.* The Hub’s [Food Trade Database](https://stats.pacificdata.org/vis) is a regional data collaboration between regional commodity and country experts, the SPC, and researchers from the University of Wollongong in Australia. In addition to making quality data on healthy, equitable, and sustainable food systems more easily discoverable and shareable, it delivers trade data on food and beverage commodities across the Pacific. According to a 2023 article, the Food Trade Database enables country and regional decision-makers to ‘review trade trends for specific foods, or groups of foods, to better understand economic and health impacts, and identify what future trade trends are likely to be.’ The database also includes an [interactive dashboard](https://app.powerbi.com/view?r=eyJrIjoiMjViNTJjNTMtMzVmMC00ZmM1LTgxZTYtOTk2NmU2Y2U0MTYyIiwidCI6ImY3MjE1MjRkLWVhNjAtNDA0OC1iYzQ2LTc1N2Q0YjVmOWZlOCIsImMiOjEwfQ%3D%3D&pageName=ReportSection26f9d9ec88abde5dce7a) on the food and beverage trade in the Pacific and a detailed [methods paper](https://sdd.spc.int/news/2023/03/31/method-cleaning-int-food-trade-data-regional-analysis-PFTD), made available as an SPC publication. *Meeting the demand for high-quality population data* The Hub provides reliable population data, essential for everything from disaster risk assessment and response to infectious disease control to coastal fisheries management. [This includes data that is available to view in population maps that take actual or projected population data and represent the spatial distribution on a continuous grid surface](https://pacificdata.org/story/pacific-population-grids). The Hub also hosts the first detailed estimates of the [coastal proximity of populations in 22 Pacific](https://pacificdata.org/story/coastal-proximity-populations-22-pacific-island-countries-and-territories) island countries and territories. The data, a collaborative project between SPC, the University of Wollongong and the not-for-profit research organisation [WorldFish](https://worldfishcenter.org/about-us), is vital data in terms of assessing vulnerability to natural disasters, economic and livelihood issues, and mitigating the impacts of climate change. ## **Building your data portal?** [Get in touch](https://linkdigital.com.au/get-in-touch/) and one of our CKAN and Drupal experts will reach out. **Portfolio Categories:** All case studies, Asia and the Pacific, AWS, Capabilities, CKAN, Drupal, Environmental/Climate Change, Industry, Managed Hosting, Multilateral organisations, Non-profit/NGO, Product Development, Region, Technology Infrastructure **Portfolio Tags:** case study, Drupal, open data portal --- ### [Canadian Watershed Information Network - University of Manotiba](https://linkdigital.com.au/case-studies/canadian-watershed-information-network-canwin/) **Published:** June 18, 2025 **Author:** Steven De Costa **Excerpt:** The CanWIN is a Canadian spatial research data infrastructure (SRDI) system hosted at the University of Manitoba. Link Digital, the CKAN and data portal expert **Content:** ***This case study was published in 2024.*** ## **About CanWIN** The Canadian Watershed Information Network ([CanWIN](https://canwin-datahub.ad.umanitoba.ca/)) is a Canadian spatial research data infrastructure (SRDI) system hosted at the University of Manitoba (UM); and managed by the [Centre for Earth Observation Science (CEOS)](https://umanitoba.ca/earth-observation-science/) within the Faculty of Environment, Earth and Resources. CEOS is a leading multidisciplinary, and collaborative research centre focused on understanding how the Earth will respond to climate change. CEOS researchers conduct their fieldwork all over the world; however, the Arctic freshwater marine system is a unifying focus of activity because climate change affects this region more acutely than anywhere else in the world. Their arctic research is also one of three signature research areas for the University, with the other two areas being in medicine. ## **Objectives of the project** Over the last 20 years, environmental and climate change, including priority concerns such as water security, have moved to the forefront of scientific and societal concerns. Projections of climate change, identification of emerging issues, and the development of evidence-based adaptation and approaches are urgent. Addressing the Arctic and freshwater change at an ecosystem scale requires access to large sets of heterogeneous data and necessitates cooperation across disciplinary, cultural, and political boundaries. This comprehensive approach requires a focused research data infrastructure (RDI) to accelerate sharing, discovery, visualisation, and analysis of diverse data, including potentially sensitive Indigenous Knowledge. The original CanWIN database was developed by the federal government department Environment and Climate Change Canada [(ECCC)](https://www.canada.ca/en/environment-climate-change.html) to share freshwater research in the Lake Winnipeg Basin. The original database was created as a relational database using Visual Studio 2008, which ultimately was not able to capture and share the complexity of the multi-disciplinary data produced. After much consultation with users and data providers, we realised the CanWIN ecosystem required a non-structured database that was flexible, modular, had an easy-to-use user interface, was open-source and had good community development support. In 2020, CanWIN had the opportunity to redevelop and redesign its current CKAN implementation to **a)** implement a distributed ecosystem consisting of multiple software platforms with CKAN as the central hub and **b)** redesign CKAN’s UI in line with the UM’s visual identity. ![Screenshot - CanWIN University of Manitoba](https://linkdigital.com.au/wp-content/uploads/2022/06/Screen-Shot-2022-06-07-at-4.50.09-pm-1-1024x775.png)CanWin Data Hub: ## **Challenges** The biggest challenge for CanWin was around showing the complex relationships between the data and the programs, sub-projects, facilities, instruments etc., the data is related to. In addition, data is collected, processed and packaged into datasets, publications or collections which contain a lot of metadata that is very useful to the data consumers and required for reproducibility. A key challenge and the initial focus of the redesign was on linking all these records in a way that allowed users to find all related information when searching and using the data, thereby minimising metadata duplication, and allowing users to view and download metadata in a human-readable format as well as make the metadata machine-readable so it is accessible to data aggregators like Google Dataset search. Another challenge was related to ensuring all these records are easily discoverable by users in a user-intuitive and easy way. After engaging Link Digital, the collaboration between CanWIN and Link’s team began to address such challenges. ![Screenshot - CanWIN University of Manitoba](https://linkdigital.com.au/wp-content/uploads/2022/06/Screen-Shot-2022-06-07-at-4.50.21-pm-1024x770.png)## **The solution: CKAN and Drupal** Link Digital completely overhauled the data portal and added a Drupal CMS component alongside CKAN. The development work was undertaken on Link Digital’s development environment, and then the overhauled portal was deployed to a staging environment for user acceptance testing before releasing it to production. ### **CKAN and FAIR Principles** [FAIR (findable, accessible, interoperable and reusable)](https://www.go-fair.org/fair-principles/): The relationships between different types of datasets and their integration into the enhanced search bar and spatial display make the data findable, and providing the data in an open-access portal makes them accessible. Furthermore, creating detailed templates mapped to internationally recognised standards (e.g. [schema.org ](http://schema.org/)and ISO-19115) and providing multiple export formats (human and machine-readable) makes the data accessible and interoperable. Finally, the creation of “data packages”, which provides users with a zipped package containing the data, the metadata in human and machine-readable formats and the data dictionary, along with any codebooks and cookbooks created, maximises the reusability of the data. Seamless integration with various data storages (like [ERDAPP](https://www.ncei.noaa.gov/erddap/index.html) or Geonode/Geoserver) has been added to allow the data to be previewed and downloaded in multiple formats without the need to duplicate and maintain the data. ERDDAP also creates and allows the export of data files in NetCDF format, which embeds key metadata into the data file itself and is considered a “gold standard” for reproducibility in a file format. The ERDDAP data is linked into CKAN to allow users to download multiple formats for data using the user-friendly CKAN interface. With the CKAN data portal now extended with a Drupal CMS, data custodians can feature and promote data and tell stories about the data. The CMS also connects users seamlessly to tools that visualise the datasets published on the portal. ## **The benefits and data principles** ![FAIR Principles](https://linkdigital.com.au/wp-content/uploads/2022/06/Can-win-1.png)FAIR Principles Link Digital ensured the solution incorporated CanWIN’s commitment to [CARE](https://www.csps-efpc.gc.ca/tools/articles/fair-care-eng.aspx), [OCAP](https://fnigc.ca/ocap-training/) and [FAIR](https://www.go-fair.org/fair-principles/) principles for data sharing – the ethical sharing of open data in a way that considers both people and purpose in open data advocacy. The need for data to be openly accessible was at the very core of the database design, specifically for data to be open broadly without restriction and on an equal basis (with exemptions for ethical reasons), to be discoverable via web-enabled standards, to have the ability to be used and understood in the context of other data both by humans and machines and to be reproduced easily to facilitate an understanding of how the data was collected and who should be contacted for additional information. The client also required that the data be built into the existing secure hosting infrastructure to safeguard against corruption and loss. To successfully achieve these benefits, Link Digital built a platform using Python on the CKAN system and utilised data schemas so data could be aggregated by federated metadata aggregators (including Google dataset search and the Canadian Federated Research Data Repository), controlled vocabularies, the Canadian Consortium for Arctic Data Interoperability [(CCADI)](https://ccadi.org/) cross-walking for common metadata standards, as well as CKAN’s native restful APIs. The end result was a distributed data ecosystem that was FAIR (findable, accessible, interoperable and reusable) and easy to use. ## **Global Benefits** CanWIN is part of the Canadian Consortium for Arctic Data Interoperability [(ccadi.org)](https://ccadi.org/) which is a pan-Canadian collaboration between 6 universities and multiple Indigenous, governmental and non-profit organisations to develop an Arctic Research Data Infrastructure (ARDI). In collaboration with additional global partners (including [POLDER, Australia](https://polder.info/)), the CCADI is building a federated data aggregator which will allow all partner repository data to be searchable from one website, as well as provide tools highlighting how the standardisation of data allows researchers to easily analyse multi-disciplinary datasets. The data available through the CCADI site can be used for a myriad of purposes including examining the impacts of climate change at local, regional and global scales, gaining an understanding of current data gaps and provide the information required to make science-based decisions and shape policy creation that aims to support the balance of ecosystem function and human activities. This was an exciting project for Link Digital, and we were thrilled to be a part of something so significant. ![Screenshot - CanWIN University of Manitoba](https://linkdigital.com.au/wp-content/uploads/2022/06/Screen-Shot-2022-06-07-at-4.50.31-pm-1024x771.png)— ## **Building an open data portal?** We are ready to start a conversation with you and your team about your open data requirements. [Contact us](https://linkdigital.com.au/get-in-touch/) and tell us about your project. **Portfolio Categories:** All case studies, AWS, Canada, Capabilities, CKAN, CKAN Migration, Drupal, End to end CKAN Services, Environmental/Climate Change, Higher Education/Research, Industry, Managed Hosting, Non-profit/NGO, Open data portal, Product Development, Region, Technology Infrastructure --- ### [Data4me: An internal data portal project by the New South Wales Government](https://linkdigital.com.au/case-studies/data4me-internal-data-portal-new-south-wales/) **Published:** May 31, 2024 **Author:** Andrew Nette **Excerpt:** Governments are placing increasing emphasis on how data is shared, internally and externally, and made discoverable for a range of human and non-human actors. **Content:** ***This case study was published in May 2024.*** ![Logo of New South Wales Government](https://linkdigital.com.au/wp-content/uploads/2024/05/NSW-logo-1.svg) ## **About the client** The New South Wales [Department of Climate Change, Energy, the Environment and Water](https://www.nsw.gov.au/departments-and-agencies/dcceew) (DCCEEW) is responsible for ensuring a sustainable NSW, including working to protect the state’s natural environment and heritage, water resources, its natural park estate, and driving the transition to a net zero economy. Funding for the Data4me project was provided by the DCCEEW’s Biodiversity, Conservations and Science Group, as part of efforts to examine how it can help transform the DCCEEW’s service delivery and improve customer service and environmental outcomes. The Data4me project was first conceptualised by [Tom Barrett, Senior Scientist in the Science, Economics and Insights Division of DCCEEW](https://www.linkedin.com/in/tom-barrett-601ba63/?originalSubdomain=au). Barrett has worked on many large-scale planning activities across all tenures and regions of NSW and is now focused on developing tools that support others to better manage and share knowledge about data and its application. [Link Digital](https://linkdigital.com.au/) partnered with Barrett and his team to make Data4me a reality. ## **Objectives of Data4me** The main driver of Data4me was Barrett’s personal experience, developing and applying Graphic Information Systems (GIS) to support conservation and natural resource management and planning decisions since 1995. “It’s a culmination of thirty years of real frustration and anguish associated with trying to use data to undertake projects,” [Barrett said in a February 2024 presentation on the project to Link Digital’s Monthly Forum series.](https://www.youtube.com/watch?v=SZ-hw7T2Ro8&t=1607s) “And I discovered that this is also shared by a lot of other data users.” The core problem Data4me seeks to solve is the challenge of finding fit-for-purpose data from the growing volume of data in open data portals at NSW state and local levels, but also nationally. This rendered the portals little better than data registries and made it difficult not only to find the right data, but also to share knowledge about it and manage data for specific projects, from the beginning and all the way through the project cycle. Data4me is an internal facing data portal that harvests data from two NSW government portals, which Link Digital also developed: DCCEEW’s internal asset register (IAR) and a public-facing repository of environment data, [Sharing and Enabling Environmental Data](https://www.seed.nsw.gov.au/) or SEED. Date4me is designed to identify and smooth over the pain points that occur over the workflow involved in using data. It does this in the following ways: **Registering a project:** Users register a new project in Data4me. This project can be made public, so that everyone in the portal can see it, or private. Users can flag others involved in a project (if these people also registered with the site) or give them the option of being included. **Searching for data:** Users can search for data and metadata by keyword or topic, registered projects or people, and organisation. The search returns a list of records with minimal summary info and users can click on the URL metadata statement to review the data in much more detail. The user also has the option to select and add datasets to their project and, thus, consolidate what they find on their own project page. **Rate and review data:** When data is downloaded and used in a project, the user usually goes through a discovery phase of reviewing the data to see if it is fit for purpose, before deciding whether to use it or not. Data4me allows the user to flag datasets as A (not used), B (used), or C (generated by project), and rate them 1-5 (with 5 being the highest) in terms of their quality, strengths, and weaknesses, etc. Users can also use a window provided to record more detailed comments of their experience of using a dataset. **Reporting:** Users can generate a report that contains a list of citations or references of the datasets they have used, which they can upload to their project site, thus completing the data life cycle. Users can also link their registered project to other information, such as a final project report or paper they have written and other data outputs, or material they have found useful. ![A screenshot of Data4me workflow - Link Digital case study](https://linkdigital.com.au/wp-content/uploads/2024/05/image-1.png)*Screenshot from [Tom’s presentation of Data4me at the Link Digital public forum](https://www.youtube.com/watch?v=SZ-hw7T2Ro8)* ![A screenshot of Data4me from the Public Form by Link Digital in 2024](https://linkdigital.com.au/wp-content/uploads/2024/05/Screenshot-2024-05-31-at-3.37.23 PM-1024x628.png)*Screenshot from [Tom’s presentation of Data4me at the Link Digital public forum](https://www.youtube.com/watch?v=SZ-hw7T2Ro8)* ## **Link Digital’s role in Data4me** Link Digital was selected to undertake the Data4me project on the basis of our extensive knowledge of the [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN), a powerful open-source software that can be configured and set up to function as an open data platform once it is deployed and hosted on a web server. CKAN was used in the implementation of DCCEEW’s IAR and SEED portals, and a decision was taken that Link Digital could use its in-depth knowledge of these two portals to better integrate them with Data4me. In addition to building a working prototype of the portal, Link Digital’s expertise included: - Enabling Data4me to harvest data from the DCCEEW IAR and SEED while filtering out duplicates from metadata. Data is automatically harvested via the Data4me application programming interface from both portals once a day. - Visual styling of the portal, which had to strictly follow NSW government design standards. - Designing Data4me to deliver a similar user experience to the DCCEEW IAR and SEED portals. - Working with client team to identify project metadata properties to be implemented. - Customizing Data4me with various plug-ins. One of these was [CKAN extension for managing datasets relationships](https://extensions.ckan.org/extension/lire/). This is normally used to link related datasets, giving people the opportunity to explore what data might be relevant to them. But Link Digital used the functionality to give the application the ability to link up these datasets to projects that are registered on Data4me. While it is envisaged that the primary use of Data4me will be on a desktop PC, the portal is ready to support mobile devices with minimum additional effort by utilising a mobile-first approach. Link Digital currently undertakes managed hosting of the portal on Amazon Web services and are also providing ongoing support with maintenance and troubleshooting. “The team at Link Digital have been fantastic to work with,” Barrett said. “It has been great. Nothing has seemed too much trouble.” ## **Benefits of Data4me** In the early stages of the open data portals, their use by the government focused more on how to deliver greater transparency. While this is still a vital consideration, governments are placing increasing emphasis on knowledge management; how data is shared, internally and externally, how it is catalogued, and made discoverable for a range of human and non-human actors. It is in this context that the benefits of the Data4me portal become particularly apparent. While the dataset extension capabilities of Data4me are not technically new, its innovative configuration delivers new functionality. In traditional data portals, users locate a data set and download and use the data outside the portal. They may, if they have the time and resources, feed their results of their research back into the portal. But, by registering projects, Data4me enables users to search for and work with data inside the actual portal itself. Projects have their own list of the data they are using, centralized in the one place, and this can be supplemented by adding external research material and documentation. And if a user wants to add additional people to the research team or hand the project over to someone else, that person knows exactly what data is being used and its lineage. ### **Other benefits of the project include:** - **Richer metadata:** Metadata often contains only the bare minimum of information. Data4me enables users to improve and build on metadata with the knowledge they have gleaned from using it – or not – and understanding what its strengths and weaknesses are, which in turn improves data comprehension and re-use. This is further enhanced by the ability to add supporting documentation that can be accessed with the dataset and is context-sensitive. - **Improved efficiency:** Data4me can save users time by enabling them to join the dots more easily between projects, documentation, people, themes, organisations, and metadata. This is done via the portal’s unique configuration and by enabling users to leave feedback on datasets that others can see, enabling datasets to be previewed for far more immediate comprehension and sense making. Enabling users to view projects and how they have used data can also potentially avoid reinventing the wheel, in terms of the research they are doing. - **Encouraging collaboration:** Enabling users to see what others are doing breaks down silos and enhances collaboration within and between different parts of the same government department or agency. ## **Future plans** Data4me has been running since 2023, so the portal is still in the early stages of its development. Even so, Link Digital believes it is a fascinating example of what is possible in relation to data portal configuration. Future directions for Data4me include: - Adding new features to help with useability. - Linking to more portals for data harvesting. In the first instance, this includes [Data.NSW](https://data.nsw.gov.au/), [NSW Climate Data Portal](https://climatedata-beta.environment.nsw.gov.au/), and the Commonwealth open data portal, [data.gov.au](https://data.gov.au/home), all of which use CKAN. This will allow users to search over 100,000 metadata records from NSW and Nationally. - Working to achieve a critical mass of users and encourage those who do use the site to leave feedback and rate datasets. This is in many respects the biggest challenge. It requires cultural change within DCCEEW to make Data4me regarded as just another tool staff use when they start a project. - Developing a new feature that will allow the Date4me team to better track adoption and user engagement. - Implementing email alerts sent to data creators to inform them their data is being used by Data4me users when it is added to projects. As part of the ongoing effort to promote and monitor the portal, the decision has been made to use it to coordinate the process around the upcoming [NSW State of Environment Report](https://www.epa.nsw.gov.au/about-us/publications-and-reports/state-of-the-environment). The report occurs every three years and is managed by the state’s Environment Protection Authority. Projects will be set up in Data4me for each of the report’s chapters, which will be used to house all the data related to that chapter. “It is a challenging and logistically complex project,” said Barrett. ‘Involving a lot of experts and a lot of data and the challenge will be to see if Data4me can help coordinate the completion of the report more easily. It is also quite a rigorous process, and the hope is that using Data4me for it will give the site added credibility and encourage more people to use it.” --- **Do you have a data project that you need assistance with?** [Tell us about your project](https://linkdigital.com.au/get-in-touch/) **Portfolio Categories:** All case studies, Australia and New Zealand, AWS, Capabilities, CKAN, Drupal, Environmental/Climate Change, Government/Public Sector, Industry, Internal data hub, Managed Hosting, Region, Technology Infrastructure --- ### [Case study: Médecins Sans Frontières Data Sharing Platform](https://linkdigital.com.au/case-studies/medecins-sans-frontieres-data-sharing-portal/) **Published:** April 8, 2024 **Author:** Andrew Nette **Content:** ***This case study was published in March 2024.*** ## **About the client** [Médecins Sans Frontières](https://www.msf.org/)/Doctors Without Borders is an independent global humanitarian organisation that provides emergency medical aid directly to people ‘affected by armed conflict, epidemics, natural disasters, and exclusion from healthcare… irrespective of race, religion, gender or political affiliation.’[\[1\]](#_ftn1) It is largely independently funded and operates in approximately 70 countries. The organisation has a global federated structure comprising of 26 self-governed associations, each of which is affiliated with one of five MSF Operational Centres: Barcelona, Paris, Geneva, Amsterdam, and Brussels, which align activities and messaging. ## **Objectives of the Data Sharing Platform** Streamlining and improving the sharing of research data collected by the organisation’s staff, including its field practitioners, both internally and with external third parties, has been a long-held wish on the part of MSF. After an initial exploration of the MSF’s internal data sharing capacity, the offices in the Netherlands and Japan jointly decided to develop a data sharing platform (DSP). They hired Link Digital to do the job. MSF were keen for a solution that provided a repository for research data and facilitated hands-off sharing, while avoiding duplication of effort or increased administrative workload for researchers. This meant tying the new platform to existing MSF systems. [Link Digital](https://linkdigital.com.au/) built the DSP based on the [Comprehensive Knowledge Archive Network](https://ckan.org/) (CKAN). The developed DSP fetches the data from the existing MSF REMIT system using the REMIT Application Programming Interface (API). This allows the new DSP to incorporate research data while building in appropriate risk/access levels. ## **Partnership between Link Digital and Médecins Sans Frontières** While [Link Digital](https://linkdigital.com.au/) has extensive experience in the application of CKAN for internal data catalogues, this was our first foray into the field of medical-related data. In addition, while MSF was seeking greater data sharing capacity, it had significant concerns related to data security and privacy, particularly around cloud security requirements for clinical data. To enable the sharing of this data while protecting people’s privacy, risk/access settings had to be added for each dataset, to determine which data are free to download or which require a request that would have to be submitted and approved. [Link Digital](https://linkdigital.com.au/) staff became part of a multi-disciplinary team that designed the new data platform. Our staff took part in a series of face-to-face meetings with MSF personnel to enable us to understand MSF’s data ambitions. We then provided advice on what could and could not be done within the existing CKAN structure and lent our expertise in designing and customising the DSP. ## **Other technical aspects of the project** The DSP allows MSF researchers to have access either as individuals or in a group, enabling them to collaborate on the publication of data assets. Working with MSF staff, [Link Digital](https://linkdigital.com.au/) augmented a CKAN-based data sharing infrastructure with [Microsoft Azure](https://azure.microsoft.com/en-au)’s cloud computing platform. The core CKAN components used in the installation were: - [Postgres](https://www.postgresql.org/), an advanced and fully scalable database management system that includes support for geospatial data. - [Apache Solr](https://solr.apache.org/), a search platform that provides fast, scalable, and reliable search capabilities for websites and data repositories. - [Redis](https://redis.io/), an in-memory data structure store used as a database, cache, and message broker. - A web server known as [Nginx](https://www.nginx.com/). In addition, the DSP installation included the following add on software components: - Remit API integration to fetch the data from MSF’s existing system, including the raw files. - A Single Mail Transfer Protocol, also called an outgoing mail server, to handle both incoming and outgoing mail. - Using [DataCite](https://datacite.org/) to enable Digital Object provision, to help uniquely identify various objects standardised by the [International Organization for Standardization](https://en.wikipedia.org/wiki/International_Organization_for_Standardization), and which are used to classify academic, professional and government information in outputs such as academic journal articles, research reports, data sets and government publications. - The use of [onetrust](https://www.onetrust.com/products/cookie-consent/) for the management of privacy and cookies. - [Microsoft Azure Active Directory](https://www.microsoft.com/en-au/security/business/identity-access/microsoft-entra-id) for single sign on. This enables users to conveniently connect to and use cloud-based apps over the Internet. ## **Benefits of the data platform** As part of MSF’s long-term objective to improve the provision of data to external parties, in addition to improving data sharing internally within MSF, the DSP will be specifically available to people outside the organisation. The platform aims to make data on a wide range of topics, including disease, emergency relief, water and sanitation, conflict, vaccination, and maternal and child health, more accessible by providing the tools to streamline publishing, and assist in the finding, sharing and using of data. The DSP includes guidance for uploading and downloading material, as well as research templates and tools for data management. In addition to the more efficient storage of data and a reduction in the administrative burden placed on MSF researchers, the new DSP aims to: - Make data more easily available for secondary research purposes and increase its potential use in advocacy initiatives around health policy/action. - Make data more available to researchers, academics and decision-makers in MSF target countries. MSF has a wealth of patient/population health data for these countries, which often lack the resources and structures to collect important health and related data by their own means. **Future plans** As of early 2024, when this case study was written, the new DSP is in a pilot phase and only contains research data from initiatives undertaken by MSF’s Amsterdam Operational Centre. The aim is to do a thorough evaluation of the platform post its pilot phase, to see what revisions must be made, after which point the other four Operational Centre’s will be encouraged to join the platform. The long term goal is for the DSP to become the centralised sharing facility for all MSF research data. Link Digital remains on hand to help test the site and address bugs and will continue to provide advice and development based on its experience with internal data sharing platforms. “We hope that [Link Digital](https://linkdigital.com.au/) will continue to provide advice and development based on its experience with other platforms,” said Johan Martens, manager of the joint project team that worked on the new platform. “The platform will most likely continue to evolve significantly in the coming years before it can find its final form. We need a reliable expert partner in this process.” **Do you have a data project that you need assistance with?** [Link Digital](https://linkdigital.com.au/) is ready to start a dialogue with you and your team on your open data needs. [Contact us and tell us about your project](https://linkdigital.com.au/get-in-touch/ "Contact us and tell us about your project"). *MSF does not endorse or promote specific services or products* --- [\[1\]](#_ftnref1) Médecins Sans Frontières. “About Us.” **Portfolio Categories:** All case studies, Application Development, Azure, Capabilities, CKAN, CKAN Migration, End to end CKAN Services, Europe, Higher Education/Research, Industry, Internal data hub, Managed Hosting, Non-profit/NGO, Open data portal, Region, Technology Infrastructure **Portfolio Tags:** open data portal --- ### [The ACT ESA - Single Point of Truth (SPOT) App](https://linkdigital.com.au/case-studies/spot-app-australian-capital-territory/) **Published:** March 25, 2022 **Author:** Steven De Costa **Excerpt:** The ACT ESA teamed up with Link Digital to build and upgrade their Single Point of Truth (SPOT) Application code base. **Content:** ***This case study was published in March 2022.*** ## **The ACT ESA – Single Point of Truth (SPOT) App** The ACT ESA comprises of the ACT Ambulance Service, ACT Fire & Rescue, ACT Rural Fire Service, ACT State Emergency Service and the ESA Enabling Services. They are responsible for the ACT community’s first-call emergency response through these services. The ACT ESA teamed up with Link Digital to build and upgrade their Single Point of Truth (SPOT) Application code base. Link Digital had supported the SPOT App for the last four years and was selected as the preferred supplier when it came time to upgrade the App. The SPOT App is an online web application designed to send automated ESA news alerts to relevant departments, stakeholders and journalists. The App allows information to be sent out to a range of personnel with one click. Public Information Officers can log in, compose and publish news alerts to the ESA website, ESA Facebook account, ESA Twitter account and through email and SMS. This allows the community to be informed of warnings in near real-time. During the 2019- 2020 bushfires, the App was used regularly to inform the ACT community about official information on severe fire warnings, including evacuations. The App disseminated warnings with minimal delay, providing the ACT community with up-to-the-minute news updates. Before the SPOT App, the alerts, posts, emails and updates were manually sent out, delaying the time for important news to reach the community. Now, everyone receives the same information at once. ![Screen shot SPOT App](https://linkdigital.com.au/wp-content/uploads/2022/03/Screen-Shot-2022-03-25-at-12.33.43-pm-1024x512.png)## **SPOT app upgrade** After years of active usage, the App needed an upgrade to reduce the time required to publish each alert as most are time-critical. The main challenge was balancing publishing time with the accuracy of the alert to ensure there were no errors in the messages. ESA and Link Digital focused primarily on these issues and added features related to the publishing experience that make the publishing process simpler and quicker. We always designed solutions to minimise the risk of publishing incorrect or misleading information. And we believe we’ve achieved this with great success. The App’s look and feel improved significantly to enhance the navigation within the App for its users. In addition, many helpful features like spell checking, autocompletes, and file management were added to support the publishing officers. Another area of focus was a technical stack to ensure business continuity for the App for years. This has been achieved by picking a well-supported and universally adopted framework to ensure the application is always up-to-date and extended as new business requirements emerge. **About a similar project** We are ready to start a dialogue with you and your team on your open data management needs. [Contact us](https://linkdigital.com.au/get-in-touch/) and tell us about your project. **Portfolio Categories:** All case studies, Application Development, Australia and New Zealand, Capabilities, CKAN, Environmental/Climate Change, Government/Public Sector, Industry, Managed Hosting, Region, Technology Infrastructure --- ### [Geoscience Data Modernisation Project (GDMP)](https://linkdigital.com.au/case-studies/geoscience-data-modernisation-project-queensland/) **Published:** October 16, 2020 **Author:** Steven De Costa **Excerpt:** Link Digital was brought into this project after the first public release of the GDMP had been deployed with a basic CKAN implementation.  **Content:** ## Geoscience Data Modernisation Project (GDMP) For the Geological Survey of Queensland (GSQ) ***This case study was published in October 2020.*** ## **Overview** GSQ plays a key role in improving understanding of Queensland’s resource potential and attracting exploration and investment in the resources sector. The GDMP seeks to unlock the value of geoscience data in Queensland. ## **CKAN Deployment** Link Digital was brought into this project after the first public release of the GDMP had been deployed with a basic CKAN implementation. Our expertise was sought because GSQ required a more sophisticated CKAN integration to provide the following: 1. Advanced search functionality 2. A variety of automated data harvesters 3. A customised metadata schema implementation that was standards-compliant & user focussed 4. Data mapping between dataset types (logical, technical and journey type matching) 5. Custom access rules and access controls ![Updated-GSQ-Open-Data-Portal-2](https://linkdigital.com.au/wp-content/uploads/2023/09/Updated-GSQ-Open-Data-Portal-2.png) ## **Data infrastructure** The primary data portal has been expanded with advanced search functionality to meet the specific discovery needs of the GDMP’s target user groups. Data is ingested through both automated harvesting and a standalone report submissions webApp. An ESRI spatial tool has been integrated with the portal for advanced mapping and visualisation. The upgraded GDMP data portal is now available at ![Updated - GSQ Open Data Portal 3](https://linkdigital.com.au/wp-content/uploads/2020/10/Updated-GSQ-Open-Data-Portal-3.png) --- **About a similar project** We are ready to start a dialogue with you and your team on your open data management needs. [Contact us](https://linkdigital.com.au/get-in-touch/) and tell us about your project. **Portfolio Categories:** All case studies, Application Development, Capabilities, CKAN, CKAN Migration, Environmental/Climate Change, Government/Public Sector, Industry, Managed Hosting, Open data portal, Technology Infrastructure --- ### [Citizen Science Hub - New South Wales](https://linkdigital.com.au/case-studies/citizen-science-hub-new-south-wales/) **Published:** August 28, 2020 **Author:** Steven De Costa **Content:** Originally published in August 2020. ***Link Digital worked closely with the NSW Department of Planning, Industry, and Environment (DPIE) to develop and implement the Citizen Science Hub (CSH) from its initial phase and integrated it with the Atlas of Living Australia and SEED data portals.*** Citizen Science Hub (CSH) is a purpose-built hub that places the citizen scientist at the center of how the DPIE engages to connect people and data, and ensures that high-quality data is collected for future use. Built as a one-stop portal for citizen scientists to see their contributions and outcomes no matter the technology they use, it aims to address current challenges, establish and support long term relationships and connect the government with the community. **About the client** Unifying the functions from the former Planning, Environment, and Industry cluster, the NSW Department of Planning, Industry, and Environment brings together specialists in urban and regional planning, natural resources, industry, environment, Aboriginal and social housing, and regional New South Wales. Comprised of six Ministers overseeing different areas of the cluster whilst sharing a common goal – to maximise the long-term wellbeing of New South Wales. Learn more about DPIE [here](https://www.dpie.nsw.gov.au/). **Objectives** Today’s advanced technology has revolutionised the way that citizen science volunteers and project organisers capture and store data. The innovation has led to an enormous amount of data being collected, though some of which is inaccessible, fragmented, or disconnected from DPIE and other repositories, and of varied/unknown quality. As a result, significant duplication of effort within the space, and a general disconnection between effort and contribution occured. Not to mention, that data cannot effectively contribute to decision making (e.g., management actions and conservation planning). Hence, DPIE reached out to the Link Digital team to develop an interactive, informative and easily sustainable Citizen Science hub within SEED that can: 1. Act as a citizen science customer establishment and relationship management system with data repository linking and aggregation functionality. 2. Facilitate networking, partnership building, collaboration, enhanced engagement, and build capacity within the citizen science community (including communication and reporting). 3. Connect people, projects and data. 4. Reduce barriers and enable the citizen science community to explore, participate and contribute to citizen science. 5. Increase transparency and visibility of citizen science actors and their activities to improve the understanding of the NSW citizen science effort and participation by the community and government. **Challenges** Every project is susceptible to experiencing problems – may it be technical, time constraints, etc. As for the Link Digital team, building CSH from scratch is no exception. As the first-ever portal of its kind in Australia, it allows the citizen science community to come together and collect environmental data using volunteer citizen scientists’ help. One challenge we overcame was the scarcity of existing projects to take ideas from during the process of building the CSH. The Link team worked around obstacles whilst integrating the portal with SEED Data Portal to show how the Citizen Science community members help collect the biodiversity data in NSW and then make this data available to everyone afterwards. With planning, consistent communication with DPIE, and the expertise of our developers, we managed to overcome these challenges and deliver agreed-upon results within the time frame. **Our solution** The Link Digital team used an iterative approach in building and gradually improving CSH’s functionality to get the best possible product. The integration was implemented via seamless linking of projects on CSH to SEED datasets. Another goal is to connect people, relevant projects, and data. To achieve this, our team paid a lot of attention to building a robust framework that will help project organisers find suitable candidates for their project based on their skills and interests and how they are relevant to a particular project. The Link team also created a powerful search engine that provides avenues for Citizen Science community members to easily find/follow projects they want to participate in or have piqued their interest. Learn more about CSH here: – [Visit NSW Department of Planning, Industry and Environment](https://www.dpie.nsw.gov.au/) – [Learn more about Citizen Science Hub](https://citizen-science.seed.nsw.gov.au/) **Portfolio Categories:** All case studies, Australia and New Zealand, Capabilities, CKAN, Drupal, Environmental/Climate Change, Government/Public Sector, Industry, Open data portal, Region, Technology Infrastructure --- ### [SEED Portal Upgrade - New South Wales](https://linkdigital.com.au/case-studies/seed-portal-upgrade-new-south-wales/) **Published:** March 19, 2020 **Author:** Steven De Costa **Content:** ***This case study was published in March 2020.*** ## **Snapshot of the project** The Link Digital team’s success hinges largely on exceptional client service, which can be seen in our strong, long-lasting relationships with clients, including the NSW Department of Planning, Industry and Environment (DPIE). Unifying the functions from the former Planning, Environment and Industry cluster, the Department brings together specialists in urban and regional planning, natural resources, industry, environment, Aboriginal and social housing and regional New South Wales. It currently comprises six Ministers overseeing different areas of the cluster whilst sharing a common goal to maximise the long-term well-being of New South Wales. As their trusted partner, our relationship with DPIE continues to grow and expand through multiple projects – some of which include developing IAR, SEED Portal, Citizen Science Hub and the Climate Data Portal. The Department of Planning, Industry and Environment wanted to redesign the SEED portal for Sharing and Enabling Environmental Data that brings together state-wide environment data about land, water, plants, animals and air. ![NSW Planning and Environment - ss](https://linkdigital.com.au/wp-content/uploads/2020/03/NSW-Planning-and-Environment-ss-1024x813.png)[Visit NSW Department of Planning, Industry and Environment](https://www.dpie.nsw.gov.au/) Working with another vendor for the design, the Link Digital team has successfully applied the new design to CKAN component of this complex portal. We worked on redesigning the CKAN component by adding some minor functionality in order to carry out the focus, which is to create a slicker, fresh look for the portal as well as improve accessibility to ensure all users can freely browse the data they need. Throughout the process, we have employed the proven effective scrum methodology. We also ensured the parts that require to be up-to-date with other components and can be edited via Drupal CMS are kept abreast. All of these components are synced and cached by CKAN. ![Home page of SEED data portal by the New South Wales - Link Digital](https://linkdigital.com.au/wp-content/uploads/2023/09/SEED-Portal--1024x607.png)[Learn more about Seed Portal](https://www.seed.nsw.gov.au/) --- **About a similar project** We are ready to start a dialogue with you and your team on your open data management needs. [Contact us](https://linkdigital.com.au/get-in-touch/) and tell us about your project. **Portfolio Categories:** All case studies, Australia and New Zealand, Capabilities, CKAN, End to end CKAN Services, Environmental/Climate Change, Government/Public Sector, Industry, Managed Hosting, Open data portal, Region, Technology Infrastructure --- ### [Pacific Monitoring Alliance for NCD Action (MANA) Dashboard](https://linkdigital.com.au/project/mana-dashboard/) **Published:** August 19, 2019 **Author:** Steven De Costa **Excerpt:** We worked together with SPC to put together the data collected by SPC Health Division to represent it in a digital format accessible to anyone online. **Content:** The Link Digital team designed and developed the Pacific Monitoring Alliance for NCD Action (MANA) that shows the status of NCD policy and legislation in Pacific Island countries and territories. We worked together with SPC to put together the data collected by SPC Health Division in order to represent it in a convenient digital format accessible to anyone online. We analysed the available data and provided 2 options of its representation in a digital form. After the low res wireframes were agreed on, the Link Digital team immediately started working on high res designs and created a fully functional prototype (using the high res design) to sufficiently test and identify any potential issues and further improvements. Once everything’s clear, we started building the dashboard. Throughout the process, we made iteration improvements, constantly reviewed the dashboard and solicited more feedback from the stakeholders. ## Key deliverables: - Project consultation and scoping via project sprints - UI/UX design work for the education dashboard - Consultation and development around various data-related issues - Highly detailed and customised showcase data visualisations, implemented via D3 JS for charts and Google Maps for spatial visualisations - Fully responsive design for desktop, mobile and tablet devices The MANA Dashboard can be found at ***This case study was published in August 2019.*** **Portfolio Categories:** All case studies, Asia and the Pacific, AWS, Capabilities, CKAN, Drupal, Industry, Multilateral organisations, Non-profit/NGO, Open data portal, Region, Technology Infrastructure --- ### [Cancer Australia Digital Transformation Compliance Project](https://linkdigital.com.au/case-studies/cancer-australia-digital-transformation-compliance-project/) **Published:** August 27, 2019 **Author:** Steven De Costa **Excerpt:** One of the main goals for this project was to simplify the complicated and confusing main navigation. **Content:** ## **Overview** Link Digital worked together with Cancer Australia to implement a significantly improved user experience journey via a contemporary and updated interface for their main website and the mini-sites for each cancer type. ## The goals To address Cancer Australia’s concerns and requirements and make the website relevant to the current user’s needs, the Link Digital team created multiple concepts for the main site and mini-sites. From there, we collaborated with Cancer Australia to refine and combine the best elements into a single concept. User experience testing feedback was taken into consideration to finalise the new look and functional changes were made to support the new design. One of the main goals for this project was to simplify the complicated and confusing main navigation. Another priority was to improve navigation between the main site and the mini-sites. To achieve these goals, we reviewed the sites Information Architecture (IA) and applied strategic design elements via an iterative process by scrutinising it to achieve the best possible results. We also made sure that the users can access the website hassle-free no matter what type of device they use. ## Key deliverables: - Project consultation and scoping via project sprints - Improved main navigation - Improved navigation between the main site and the mini-sites so users can access information from a single platform - UX/UI design work - Fully responsive design for desktop, mobile and tablet devices ***This case study was published in August 2019.*** **Portfolio Categories:** All case studies, Australia and New Zealand, Capabilities, Drupal, Government/Public Sector, Industry, Managed Hosting, Region, Technology Infrastructure --- ### [Cancer Australia on Drupal 7](https://linkdigital.com.au/case-studies/cancer-australia/) **Published:** August 20, 2019 **Author:** Steven De Costa **Excerpt:** Link Digital launched the redesigned Cancer Australia website in August 2019 and has been maintaining the site since 2017. **Content:** Cancer Australia is an organisation founded in 2006 that aims to raise awareness to support people affected by cancer within Australia. As the Australian Government’s lead cancer control agency, Cancer Australia continuously works hard to reduce the impact of cancer, address disparities and improve outcomes for people affected by cancer. Link Digital launched the redesigned Cancer Australia website in August 2019 and has been maintaining the site since 2017. Link is also responsible for the content management modernisation of 10 separate sites and 32 mini-sites, all of which are customised Drupal 7 installations. The Breast Cancer Risk Factors website which was created to categorise and detail risk factors, protective factors, modifiable factors and factors that are unproven or unlikely, on a publicly accessible platform was launched in 2018. – [Visit Cancer Australia](https://canceraustralia.gov.au/) – [Learn more about the Children’s Cancer website](https://linkdigital.com.au/news/2020/09/online-hub-launched-for-cancer-australia/) ***This page was published in August 2019.*** **Portfolio Categories:** All case studies, Australia and New Zealand, AWS, Drupal, Government/Public Sector, Managed Hosting, Open data portal, Product Development, Region --- ### [CKAN Association](https://linkdigital.com.au/linkdigital/) **Published:** February 18, 2018 **Author:** Steven De Costa **Content:** CKAN Association Membership is a way for individuals, companies and organisations to support the CKAN Project and be recognised for doing so. Via Link Digital’s support within the CKAN Tech Team, Steering Group and Community and Communications Team we help to ensure the CKAN open source project continues to thrive within the open data community. The volume of in-kind support we supply has earned us the status of Gold Membership within the CKAN Association. Our work in supporting the CKAN project provides direct benefit to clients of our [CKAN and Open Data Services](https://linkdigital.com.au/ckan/). ***This content was published in February 2018.*** **Portfolio Categories:** All case studies --- ### [Open Knowledge Australia](https://linkdigital.com.au/project/open-knowledge-australia/) **Published:** February 18, 2018 **Author:** Steven De Costa **Content:** Open Knowledge Australia (OKAU) is a community volunteer driven initiative which brings together people who believe the world is a better place when we [share our data, information and knowledge in the open, making us all wiser](http://en.wikipedia.org/wiki/DIKW_Pyramid) in our everyday interaction as open communities. While our staff may volunteer personal time to support OKAU independently, Link Digital provides bookkeeping services which help the organisation manage accounts and banking with reduced administration within its team of volunteers. As a result, Link Digital is proud to be recognised by it’s Board as a supporting partner of Open Knowledge Australia. ***This page was published in February 2018.*** **Portfolio Categories:** All case studies, Australia and New Zealand, Region --- ### [GitHub](https://linkdigital.com.au/linkdigital/) **Published:** February 18, 2018 **Author:** Steven De Costa **Content:** Link Digital is accredited as a GitHub Enterprise Systems Integrator partner and can help you with licensing, integration and managed hosting for your own private installation of GitHub. Soon after presenting our [model for frictionless science](https://linkdigital.com.au/news/2015/12/is-there-a-model-for-friction-less-science/) and governance of Government managed open source software to GitHub management in San Francisco in 2016 we signed as a partner. We have since shown how [CKAN resource views for GitHub.com](https://linkdigital.com.au/news/2016/09/link-digital-delivers-on-white-house-open-data-commitments/) can provide a simple way for data portals to also catalogue and share open source project repositories. Giving jurisdictions an avenue for the promotion of civic collaboration within the context of public initiatives. ***This page was published in February 2018.*** **Portfolio Categories:** All case studies --- ### [Australian Government's Educational Online Portal](https://linkdigital.com.au/case-studies/tax-super-you/) **Published:** February 17, 2018 **Author:** Steven De Costa **Excerpt:** Link Digital provides hosting and support services to maintain the Drupal website while also redeveloping a number of the educational interactives for improved accessibility and comparability with mobile devices. **Content:** ## Overview Tax, Super + You is an educational online resource provided free of charge by the Australian Tax Office. Teachers can use the resource to help students improve their understanding of the Australian tax and super systems. ## Hosting and support Link Digital provides hosting and support services to maintain the Drupal website while also redeveloping a number of the educational interactives for improved accessibility and comparability with mobile devices. The Paying It Forward resource was the latest to be converted into an interactive HTML format, from PDF. This change allows alterations to be made in real time and be immediately accessible, so resources are never outdated! [Visit the Tax, Super + You website](https://www.taxsuperandyou.gov.au) [Take a look at the Paying it Forward resource](https://www.taxsuperandyou.gov.au/paying-it-forward) ***This case study was published in February 2018.*** **Portfolio Categories:** All case studies, Application Development, AWS, Drupal, Managed Hosting --- ### [Drupal 7 Responsive Site Design and Development | Australians at War Film Archive](https://linkdigital.com.au/project/australians-war-film-archive/) **Published:** February 15, 2018 **Author:** Steven De Costa **Content:** ## Drupal 7 Responsive Site Design and Development [www.australiansatwarfilmarchive.unsw.edu.au](https://australiansatwarfilmarchive.unsw.edu.au/) Link Digital was engaged by the University of New South Wales to find the appropriate technological solution for the development of a website featuring over two thousand Australian Defence Force veteran video interviews encompassing Australia’s wartime history from World War One to Afghanistan. The new Australians at War Film Archive website was developed using Drupal. It leverages the Amazon Web Services (AWS) distributed content delivery network to provide network edge delivery of media files and transcoding service. The solution is robust enough to handle multiple users simultaneously requesting large video files in addition to facilitating complex search functionality. ### Key deliverables: - Extensive stakeholder consultation - Development of personas, user journeys and Information Architecture - Production of wireframe layouts and user interface design concepts - Functional and Technical Specifications and Load Test Case documentation - Scalable, self-healing cloud based environment utilising CatDV, Drupal and AWS with the Drupal application residing in Virtual Private Cloud. - Complex search functionality ***This case study was published in February 2018.*** **Portfolio Categories:** All case studies, Application Development, Australia and New Zealand, AWS, Drupal, Managed Hosting, Region --- ### [Brisbane City Council Open Data Portal](https://linkdigital.com.au/case-studies/brisbane-city-council/) **Published:** December 29, 2017 **Author:** Steven De Costa **Content:** The [Brisbane City Council open data portal](https://data.brisbane.qld.gov.au/pages/home/) was launched in 2015 with the aim of providing an easy way to locate, access, and share the city’s public data assets. One of the earlier open data portals built by Link Digital, we built it using the powerful open source data management software known as CKAN ([the Comprehensive Knowledge Archive Network](https://linkdigital.com.au/ckan/)). Additional features were implemented using [Drupal](https://linkdigital.com.au/news/2024/10/drupal-why-organisations-should-use-it-as-part-of-their-open-data-management/), a flexible open source content management system that is used to build websites. For a time, Link Digital was also responsible for the ongoing management on the portal on [Amazon Web Services](https://linkdigital.com.au/aws/). The Brisbane City Council’s portal adopted a metadata schema shared by the [Australian Government’s open data portal](https://data.gov.au/home), and other state government portals. This enables interoperability with those portals and the [Queensland Government Open Data Portal](https://www.data.qld.gov.au/). The portal holds a wide variety of datasets, including parks and recreation, city planning, the environment, arts and culture, community safety, and public transport (CityCat and ferry services, a listing of CityHopper timetables and ferry terminals references for the Brisbane Ferries Monitoring API). These datasets are available in a wide variety of formats, including CSV, KML, and HTML files. Read more about the initial work to [establish the Council’s open data portal](https://linkdigital.com.au/news/2015/07/brisbane-city-council-launches-its-new-open-data-platform/). ***This case study was published in December 2017.*** **Portfolio Categories:** All case studies, Australia and New Zealand, AWS, CKAN, Drupal, Managed Hosting, Region **Portfolio Tags:** case study, open data portal --- ### [Data management system - NSW Office of Environment and Heritage](https://linkdigital.com.au/case-studies/nsw-office-environment-heritage-data-management-system/) **Published:** August 8, 2017 **Author:** Steven De Costa **Content:** *This case study was published in August 2017.* The public data portal allows users to discover and download datasets and information resources held by the Office of Environment and Heritage (OEH). Developed with CKAN, you can search for data either by: - Entering a search term in the Search box or; - Clicking on one of the “Popular keyword searches”; and/or - Defining an area of interest on the “Search Spatially” map. Behind the public data portal is an Information Asset Register (IAR) which is also based on CKAN. Within the IAR Data custodians manage metadata, the compliance with governance standards and data quality statements. They also manage dataset resources and trigger publishing workflows which syndicate data records through to dataNSW and the public data portal. **Portfolio Categories:** All case studies, Australia and New Zealand, AWS, CKAN, Region --- ### [CKAN hosting support for New South Wales](https://linkdigital.com.au/case-studies/ckan-hosting-support-data-nsw-gov-au/) **Published:** July 17, 2017 **Author:** Steven De Costa **Excerpt:** The upgraded version of data.nsw.gov.au made it easier for people to access datasets uploaded by government agencies with advanced search functions. **Content:** ## CKAN Hosting and Support for Data.NSW [www.data.nsw.gov.au](http://www.data.nsw.gov.au) Data.NSW brings together a list of NSW Government datasets available in one searchable website. The NSW Government aims to make data more accessible to the public and to industry to stimulate innovative approaches to service delivery. NSW has been publishing government data online since 2009. In 2013 a new, upgraded version of [data.nsw.gov.au](http://data.nsw.gov.au) made it easier for people to access datasets uploaded by government agencies with advanced search functions. ### Key Deliverables: - Setup of UAT and Production environments for ongoing development - Integration with Drupal for publishing - Technical infrastructure advice - Responsive build - On-going hosting, support and maintenance **Portfolio Categories:** All case studies, Australia and New Zealand, CKAN, Drupal, Managed Hosting, Region --- ### [CKAN Hosting and Support for Australian Federal Open Data Portal](https://linkdigital.com.au/case-studies/australian-government-open-data-portal-ckan-hosting-support/) **Published:** July 13, 2017 **Author:** Steven De Costa **Content:** Data.gov.au is the National portal of Australian Open Government Data and is a central catalogue for the discovery public data. It also provides hosting for tabular, spatial and relational data with hosted APIs and the option for agencies to link data and services hosted by other government sources. Improving the quantity and quality of the government data and the [data.gov.au](http://data.gov.au) stack is an ongoing process which Link Digital has supported for several years. We manage hosting for [data.gov.au](https://data.gov.au) on Amazon Web Services and monitor 24/7 up time and performance. **Portfolio Categories:** All case studies, Australia and New Zealand, AWS, CKAN, Government/Public Sector, Managed Hosting, Open data portal, Region --- ### [WeAreCBR Online Precinct](https://linkdigital.com.au/project/wearecbr/) **Published:** February 17, 2018 **Author:** Steven De Costa **Content:** In November 2015, initial support from [ACT Government](http://www.act.gov.au/), the [eGov Cluster](https://www.nicta.com.au/category/industry-engagement/broadband-and-the-digital-economy/projects/egov-cluster/) and Link Digital saw the establishment of the WeAreCBR Online Precinct steering group. In 2018, outgoing president of the Australian Computer Society’s ACT Branch, Adrian Armitage, joined the steering group to replace Steven De Costa as its Chair. Link Digital continues to support the initiative and is working with Adrian to secure funding for further development and growth in 2018. Steering group members: - Adrian Armitage (Chair) - Steven De Costa, representing Link Digital - Glen Hassett, representing ACT Government and Brand Canberra This initiative received inspiration from our winning entry in the [Digital Canberra Challenge](https://linkdigital.com.au/news/tag/wearecbr/). --- ### [The Australian Red Cross Centenary](https://linkdigital.com.au/news/project/the-australian-red-cross-centenary/) **Published:** February 15, 2018 **Author:** Steven De Costa **Content:** ## Drupal 7 Responsive Site Design and Development [www.centenary.redcross.org.au](http://www.centenary.redcross.org.au) The Australian Red Cross cooperated with Link Digital to build a centenary website on a contemporary, functional platform. Whilst the website launched and celebration centred around the 100 year anniversary on 13 August 2014, Australian Red Cross’s long term aim is to create an innovative platform with the ability to ingest new data from third party sources to continue weaving together the story. For example, the data first design of the website has the ability to align with rich data from institutional archives such as the Australian National Library, bringing together a phenomenal mass of national content in one accessible platform. The site is developed over the top of a [Drupal Commons](https://www.drupal.org/project/commons) installation, which will allow us to expand the site into a full content hub. The site is hosted on [Amazon Web Services](https://aws.amazon.com/) (AWS) and monitored 24/7 by [CloudWatch](https://aws.amazon.com/cloudwatch/) to trigger the [automatic scale up](https://aws.amazon.com/autoscaling/) of web servers as the site comes under load. The Red Cross is publicising the site via various media channels, so load on the environment is highly variable. Using AWS allows us to maintain a highly responsive site at a minimum cost to our client. In the past year, the Australian Red Cross Centenary website has recorded over 32,000 site visits, more than 150,000 page views and has gathered over 600 personal stories. As we move towards a future of open data the ability for intelligent digital conversations to be created allowing public access to vast datasets is now more real than ever before. ### Key Deliverables: - Project consultation and scoping via project sprint - Information architecture and wireframe development - User interface design and development - Technical infrastructure advice and development - Setup of development and production environments for ongoing development - Dynamic content display for multiple content items (video, audio, images, text, directory records, events and promotions) - Integration with Drupal for publishing - Fully responsive design for desktop, mobile and tablet devices. Find out more information about our cooperation with **the Australian Red Cross** on [our blog](/news/2013/09/the-australian-red-cross-centenary/). **Portfolio Categories:** All case studies, AWS, Drupal, Managed Hosting **Portfolio Tags:** case study, Drupal --- ## Categories ### [All articles](https://linkdigital.com.au/news/category/articles/) **Description:** Here you will find the collection of articles written by the Link Digital team. These are the insights, reports, and projects across industries from the public Sector, non-profit/NGO, environmental/climate change, higher education, and multilateral organisations. --- ### [Technology Infrastructure](https://linkdigital.com.au/news/category/technology-infrastructure/) **Description:** Public sector entities and large organisations worldwide recognise Link Digital as the trusted CKAN expert. They build open data portals and internal data hubs. Link Digital is a Drupal expert, too. They build the sites for Cancer Australia, New South Wales’ Vehicle Emission Star Rating project and more. --- ### [Government](https://linkdigital.com.au/news/category/industry/government/) **Description:** Link Digital has partnered with government agencies/the public sector in building open data portals and creating internal data hubs. --- ### [Open Data](https://linkdigital.com.au/news/category/topics/open-data/) **Description:** Comprehensive open data resources, policy insights, and implementation strategies for transparent and accessible data initiatives. --- ### [Drupal](https://linkdigital.com.au/news/category/technology-infrastructure/drupal/) **Description:** Link Digital has built sites based on Drupal. Link Digital are Drupal experts; along with CKAN, the open source data management system, they worked on many open data portals worldwide. --- ### [Amazon Web Services (AWS)](https://linkdigital.com.au/news/category/technology-infrastructure/amazon-web-services/) **Description:** Link Digital is an AWS certified partner. If you are looking for an AWS expert for your digital infrastructure, partner with Link Digital to ensure reliability, scalability, and inexpensive cloud computing services. --- ### [CKAN](https://linkdigital.com.au/news/category/technology-infrastructure/ckan/) **Description:** Governments, NGOs, and multilateral organizations worldwide recognize Link Digital as their trusted CKAN partner. Link Digital are the major contributors and maintainers of CKAN open source project, as half of the CKAN core tech team are from Link Digital. --- ### [Environmental/Climate Change](https://linkdigital.com.au/news/category/topics/environment-climate/) **Description:** Link Digital has partnered with organisations that work on environmental or climate change advocacy. Link Digital are experts in building climate data hubs based on CKAN for governments, NGOs, and research organisations. --- ### [Artificial Intelligence](https://linkdigital.com.au/news/category/topics/artificial-intelligence/) **Description:** Read articles from Link Digital with insights on data management system along with artificial intelligence (AI). --- ### [Tutorial](https://linkdigital.com.au/news/category/resources/tutorial/) **Description:** As a recognised CKAN expert worldwide, Link Digital shares CKAN tech tutorials with developers, data administrators, and users. --- ### [Resources](https://linkdigital.com.au/news/category/resources/) **Description:** As a recognised CKAN experts worldwide, Link Digital shares best practices, tech tutorials, and video explainers for developers, data administratos and users. --- ### [Internal data hub](https://linkdigital.com.au/news/category/topics/internal-data-hub/) **Description:** Link Digital is your go-to service provider if you are building your internal data management system. The security of a CKAN-based internal data management platform can be further enhanced by engaging a third-party service provider, such as Link Digital. --- ### [Higher Education/Research](https://linkdigital.com.au/news/category/industry/research/) **Description:** Link Digital has partnered with organisations that focus on academia and research institutions. Browse the articles to see all the insights and projects they’ve worked on. --- ### [Geospatial](https://linkdigital.com.au/news/category/topics/geospatial/) **Description:** Link Digital has partnered with organisations that work on environmental or climate change advocacy. Read the articles related to Geospatial. They are experts in building climate data hubs for governments, NGOs, and research organisations. --- ### [DCAT (Data Catalog Vocabulary)](https://linkdigital.com.au/news/category/topics/dcat/) **Description:** Comprehensive DCAT resources, implementation guides, and metadata standards for effective data catalog management and interoperability. --- ### [Microsoft Azure](https://linkdigital.com.au/news/category/technology-infrastructure/microsoft-azure/) **Description:** Azure is Microsoft’s cloud computing platform. Link Digital utilizes it to host open data platforms and enterprise data solutions with CKAN – the open-source data management system used to power internal data catalogues and public-facing data portals that makes it easy for organisations to publish, share, and work with data. --- ### [Industry](https://linkdigital.com.au/news/category/industry/) **Description:** Link Digital works with Government/Public Sector, Non-profit/NGO, Environmental/Climate Change, Higher Education and Multilateral organisations in building data hubs and open data portals based on open source technologies like CKAN and Drupal. --- ### [Topics](https://linkdigital.com.au/news/category/topics/) **Description:** Browse the topics covered by Link Digital. They are experts in application development, managed hosting, building internal data hubs and open data portals. --- ### [Smart City](https://linkdigital.com.au/news/category/topics/smart-city/) --- ### [Thought Leadership](https://linkdigital.com.au/news/category/thought-leadership/) **Description:** Here you’ll find the articles and insights released by the leadership team of Link Digital. --- ### [Steven De Costa](https://linkdigital.com.au/news/category/thought-leadership/steven-de-costa/) **Description:** Steven De Costa is the Executive Director and Chairman of Link Digital. A company recognised as a CKAN expert. --- ### [Kate Sampher](https://linkdigital.com.au/news/category/thought-leadership/kate-sampher/) **Description:** Kate Sampher is a marketing professional who has worked with B2B, B2C and B2G worldwide. With experience in marketing content strategy, SEO best practices, and email marketing campaigns. --- ### [Environmental/Climate Change](https://linkdigital.com.au/news/category/industry/environmental-climate-change/) **Description:** Link Digital has partnered with organisations that work on environmental or climate change advocacy. They are experts in building climate data hubs for governments, NGOs, and research organisations. --- ### [Non-profit/NGO](https://linkdigital.com.au/news/category/industry/non-profit-ngo/) **Description:** Link Digital has partnered with nonprofit organisations and NGOs. They are experts in building CKAN-based data hubs and open data portals. --- ### [Digital Public Infrastructure](https://linkdigital.com.au/news/category/topics/digital-public-infrastructure/) --- ### [Objective Observe Initiative](https://linkdigital.com.au/news/category/objective-observe-initiative/) --- ## Tags ### [CKAN](https://linkdigital.com.au/news/tag/ckan/) **Description:** Explore CKAN-related news, tutorials, and insights from Link Digital. Learn about open-source data management platform implementation and best practices. --- ### [Amazon Web Services](https://linkdigital.com.au/news/tag/amazon-web-services/) --- ### [Canberra web design](https://linkdigital.com.au/news/tag/canberra-web-design/) --- ### [responsive design](https://linkdigital.com.au/news/tag/responsive-design/) --- ### [Government web designe](https://linkdigital.com.au/news/tag/government-web-designe/) --- ### [Canberra database integration](https://linkdigital.com.au/news/tag/canberra-database-integration/) --- ### [Canberra web development](https://linkdigital.com.au/news/tag/canberra-web-development/) --- ### [Village Building](https://linkdigital.com.au/news/tag/village-building/) --- ### [Drupal](https://linkdigital.com.au/news/tag/drupal/) **Description:** Drupal development insights, content management strategies, and integration solutions for data-driven websites and portals. --- ### [Government](https://linkdigital.com.au/news/tag/government/) --- ### [research data](https://linkdigital.com.au/news/tag/research-data/) --- ### [GitHub](https://linkdigital.com.au/news/tag/github/) --- ### [open data](https://linkdigital.com.au/news/tag/open-data/) **Description:** Open data initiatives, policy frameworks, and implementation strategies for transparent and accessible public information sharing. --- ### [AWS](https://linkdigital.com.au/news/tag/aws/) **Description:** AWS cloud solutions for data management, scalable infrastructure deployment, and best practices for data portal hosting on Amazon Web Services. --- ### [docker](https://linkdigital.com.au/news/tag/docker/) --- ### [lagoon](https://linkdigital.com.au/news/tag/lagoon/) --- ### [climate data](https://linkdigital.com.au/news/tag/climate-data/) **Description:** Climate data management, environmental monitoring systems, and data-driven solutions for climate research and policy making. --- ### [corporate data](https://linkdigital.com.au/news/tag/corporate-data/) --- ### [CKAN Training](https://linkdigital.com.au/news/tag/ckan-training/) --- ### [Vietnam](https://linkdigital.com.au/news/tag/vietnam/) --- ### [opendata](https://linkdigital.com.au/news/tag/opendata/) --- ### [#ckan3.0](https://linkdigital.com.au/news/tag/ckan3-0/) --- ### [Geospatial Metadata Mapping](https://linkdigital.com.au/news/tag/geospatial-metadata-mapping/) --- ### [arn](https://linkdigital.com.au/news/tag/arn/) --- ### [finalist](https://linkdigital.com.au/news/tag/finalist/) --- ### [awards](https://linkdigital.com.au/news/tag/awards/) --- ### [techstack](https://linkdigital.com.au/news/tag/techstack/) --- ### [data](https://linkdigital.com.au/news/tag/data/) --- ### [opendataaudit](https://linkdigital.com.au/news/tag/opendataaudit/) --- ### [opengovernment](https://linkdigital.com.au/news/tag/opengovernment/) --- ### [opendatasummit](https://linkdigital.com.au/news/tag/opendatasummit/) --- ### [canadianopendatasummit](https://linkdigital.com.au/news/tag/canadianopendatasummit/) --- ### [#canadiangoverment](https://linkdigital.com.au/news/tag/canadiangoverment/) --- ### [year in review](https://linkdigital.com.au/news/tag/year-in-review/) --- ### [open data day](https://linkdigital.com.au/news/tag/open-data-day/) --- ### [OKFN](https://linkdigital.com.au/news/tag/okfn/) --- ### [OpenDataToAI](https://linkdigital.com.au/news/tag/opendatatoai/) --- ### [#BetterTogetherThanAlone](https://linkdigital.com.au/news/tag/bettertogetherthanalone/) --- ### [ckan2.10](https://linkdigital.com.au/news/tag/ckan2-10/) --- ### [datastore](https://linkdigital.com.au/news/tag/datastore/) --- ### [datapusher](https://linkdigital.com.au/news/tag/datapusher/) --- ### [ubuntu](https://linkdigital.com.au/news/tag/ubuntu/) --- ### [installationguide](https://linkdigital.com.au/news/tag/installationguide/) --- ### [climate](https://linkdigital.com.au/news/tag/climate/) --- ### [digital public good](https://linkdigital.com.au/news/tag/digital-public-good/) --- ### [govhack](https://linkdigital.com.au/news/tag/govhack/) --- ### [2023 open government partnership](https://linkdigital.com.au/news/tag/2023-open-government-partnership/) --- ### [OGP](https://linkdigital.com.au/news/tag/ogp/) --- ### [Tallinn](https://linkdigital.com.au/news/tag/tallinn/) --- ### [Estonia](https://linkdigital.com.au/news/tag/estonia/) --- ### [TRUST](https://linkdigital.com.au/news/tag/trust/) --- ### [opensource](https://linkdigital.com.au/news/tag/opensource/) --- ### [good data](https://linkdigital.com.au/news/tag/good-data/) --- ### [Machine learning](https://linkdigital.com.au/news/tag/machine-learning/) --- ### [generative ai](https://linkdigital.com.au/news/tag/generative-ai/) --- ### [FAIR Principles](https://linkdigital.com.au/news/tag/fair-principles/) --- ### [open knowledge](https://linkdigital.com.au/news/tag/open-knowledge/) --- ### [open government](https://linkdigital.com.au/news/tag/open-government/) --- ### [open data movement](https://linkdigital.com.au/news/tag/open-data-movement/) --- ### [digital government](https://linkdigital.com.au/news/tag/digital-government/) --- ### [sustainability](https://linkdigital.com.au/news/tag/sustainability/) --- ### [water week](https://linkdigital.com.au/news/tag/water-week/) --- ### [Company Announcement](https://linkdigital.com.au/news/tag/company-announcement/) --- ### [Link Digital CTO](https://linkdigital.com.au/news/tag/link-digital-cto/) --- ### [Canada](https://linkdigital.com.au/news/tag/canada/) --- ### [partnership](https://linkdigital.com.au/news/tag/partnership/) --- ### [Community](https://linkdigital.com.au/news/tag/community/) --- ### [Tutorial](https://linkdigital.com.au/news/tag/tutorial/) --- ### [Secure Data Exchange](https://linkdigital.com.au/news/tag/secure-data-exchange/) --- ### [Link Digital](https://linkdigital.com.au/news/tag/link-digital/) --- ### [Data Custodians](https://linkdigital.com.au/news/tag/data-custodians/) --- ### [data sharing](https://linkdigital.com.au/news/tag/data-sharing/) **Description:** Data sharing best practices, policies, and technical solutions for secure and effective information exchange across organizations. --- ### [open source](https://linkdigital.com.au/news/tag/open-source/) **Description:** Open-source data management tools, community-driven solutions, and implementation strategies for cost-effective data platforms. --- ### [government data management](https://linkdigital.com.au/news/tag/government-data-management/) **Description:** Government data management frameworks, public sector data governance, and compliance strategies for effective data stewardship. --- ### [internal data management](https://linkdigital.com.au/news/tag/internal-data-management/) **Description:** Internal data management strategies, organizational data governance, and enterprise data architecture solutions for businesses. --- ### [open data portal](https://linkdigital.com.au/news/tag/open-data-portal/) **Description:** Open data portal development, implementation strategies, and best practices for creating accessible and user-friendly data platforms. --- ### [data security](https://linkdigital.com.au/news/tag/data-security/) **Description:** Data security best practices, privacy protection strategies, and compliance frameworks for secure data management systems. --- ### [Gov data](https://linkdigital.com.au/news/tag/gov-data/) **Description:** Government data management solutions, public sector data strategies, and compliance frameworks for effective data governance. --- ### [digital public goods](https://linkdigital.com.au/news/tag/digital-public-goods/) --- ### [CKAN community](https://linkdigital.com.au/news/tag/ckan-community/) --- ### [CanWIN](https://linkdigital.com.au/news/tag/canwin/) --- ### [metadata](https://linkdigital.com.au/news/tag/metadata/) --- ### [DCAT](https://linkdigital.com.au/news/tag/dcat/) **Description:** DCAT (Data Catalog Vocabulary) implementation guides, standards, and best practices for metadata management in data portals. --- ### [Pacific Data Hub](https://linkdigital.com.au/news/tag/pacific-data-hub/) --- ### [extensions](https://linkdigital.com.au/news/tag/extensions/) --- ### [Link Digital staff](https://linkdigital.com.au/news/tag/link-digital-staff/) --- ### [Columbia Basin Water Hub](https://linkdigital.com.au/news/tag/columbia-basin-water-hub/) --- ### [Living Lakes Cambodia](https://linkdigital.com.au/news/tag/living-lakes-cambodia/) --- ### [Living Lakes Canada](https://linkdigital.com.au/news/tag/living-lakes-canada/) --- ### [Data visualisation](https://linkdigital.com.au/news/tag/data-visualisation/) --- ### [water data management](https://linkdigital.com.au/news/tag/water-data-management/) --- ### [data workflow patterns](https://linkdigital.com.au/news/tag/data-workflow-patterns/) --- ### [secure data](https://linkdigital.com.au/news/tag/secure-data/) --- ### [migration](https://linkdigital.com.au/news/tag/migration/) --- ### [data portal](https://linkdigital.com.au/news/tag/data-portal/) **Description:** Data portal development, management strategies, and user engagement techniques for effective data publication and discovery. --- ### [enterprise data solutions](https://linkdigital.com.au/news/tag/enterprise-data-solutions/) --- ### [Azure](https://linkdigital.com.au/news/tag/azure/) --- ### [private sector](https://linkdigital.com.au/news/tag/private-sector/) --- ### [open data portals](https://linkdigital.com.au/news/tag/open-data-portals/) **Description:** Open data portal development, deployment strategies, and management best practices for transparent and accessible government data. --- ### [climate resilience](https://linkdigital.com.au/news/tag/climate-resilience/) **Description:** Climate resilience strategies through open data, data-driven solutions, and insights for building adaptive systems in response to climate change challenges. --- ### [climate change](https://linkdigital.com.au/news/tag/climate-change/) **Description:** Climate change data analysis, environmental impact assessment, and data-driven strategies for climate adaptation and mitigation. --- ### [Data governance](https://linkdigital.com.au/news/tag/data-governance/) --- ### [Data quality](https://linkdigital.com.au/news/tag/data-quality/) --- ### [GIS](https://linkdigital.com.au/news/tag/gis-capable-data-portals/) --- ### [geospatial data](https://linkdigital.com.au/news/tag/geospatial-data/) --- ### [Geographic Information Systems](https://linkdigital.com.au/news/tag/geographic-information-systems/) --- ### [smart city technology](https://linkdigital.com.au/news/tag/smart-city-technology/) --- ### [digital twins](https://linkdigital.com.au/news/tag/digital-twins/) --- ### [non traditional data sources](https://linkdigital.com.au/news/tag/non-traditional-data-sources/) --- ### [Demo day](https://linkdigital.com.au/news/tag/demo-day/) --- ### [CKAN extension](https://linkdigital.com.au/news/tag/ckan-extension/) --- ### [open source software](https://linkdigital.com.au/news/tag/open-source-software/) --- ### [Harvard School of Business](https://linkdigital.com.au/news/tag/harvard-school-of-business/) --- ### [International Women's Month](https://linkdigital.com.au/news/tag/international-womens-month/) --- ### [Improve public trust](https://linkdigital.com.au/news/tag/improve-public-trust/) --- ### [CKAN API](https://linkdigital.com.au/news/tag/ckan-api/) --- ### [data storytelling](https://linkdigital.com.au/news/tag/data-storytelling/) **Description:** Master data storytelling techniques, visualization strategies, and narrative approaches to make data insights more compelling and accessible. --- ### [data collection](https://linkdigital.com.au/news/tag/data-collection/) **Description:** Data collection methodologies, automated gathering techniques, and quality assurance practices for reliable data acquisition. --- ### [data catalog](https://linkdigital.com.au/news/tag/data-catalog/) **Description:** Data catalog solutions, metadata management, and data discovery tools for improving organizational data accessibility and governance. --- ### [The Pacific Data Hub](https://linkdigital.com.au/news/tag/the-pacific-data-hub/) --- ### [ocean science data](https://linkdigital.com.au/news/tag/ocean-science-data/) --- ### [the Pacific Community](https://linkdigital.com.au/news/tag/the-pacific-community/) --- ### [data stewardship](https://linkdigital.com.au/news/tag/data-stewardship/) --- ### [Pacific Community](https://linkdigital.com.au/news/tag/pacific-community/) --- ### [collaborative data governance](https://linkdigital.com.au/news/tag/collaborative-data-governance/) --- ### [Thought Leadership](https://linkdigital.com.au/news/tag/thought-leadership/) **Description:** Thought leadership articles on data management, digital transformation, and data management practices from Link Digital experts. --- ### [polycrisis](https://linkdigital.com.au/news/tag/polycrisis/) --- ### [public sector governance](https://linkdigital.com.au/news/tag/public-sector-governance/) --- ### [digitisation](https://linkdigital.com.au/news/tag/digitisation/) --- ### [Creative Bureaucracy Festival 2025](https://linkdigital.com.au/news/tag/creative-bureaucracy-festival-2025/) --- ### [GeoPackages](https://linkdigital.com.au/news/tag/geopackages/) --- ### [Managed hosting](https://linkdigital.com.au/news/tag/managed-hosting/) --- ### [CKAN hosting](https://linkdigital.com.au/news/tag/ckan-hosting/) **Description:** CKAN hosting solutions, infrastructure requirements, and deployment strategies for scalable and reliable data portal hosting. --- ### [Cloud computing](https://linkdigital.com.au/news/tag/cloud-computing/) **Description:** Cloud computing strategies for data management, scalable infrastructure solutions, and migration best practices for data platforms. --- ### [DOI](https://linkdigital.com.au/news/tag/doi/) **Description:** Digital Object Identifier (DOI) implementation, data citation standards, and persistent identifier best practices for research data and open data. --- ### [CKAN Docker](https://linkdigital.com.au/news/tag/ckan-docker/) **Description:** Learn about CKAN Docker deployment, containerization strategies, and best practices for scalable data portal infrastructure. --- ### [user experience](https://linkdigital.com.au/news/tag/user-experience/) **Description:** User experience design principles for data portals, interface optimization, and creating intuitive data discovery experiences. --- ### [UX design](https://linkdigital.com.au/news/tag/ux-design/) **Description:** UX design principles for data applications, user interface optimization, and creating engaging experiences for data portal users. --- ### [Steven De Costa](https://linkdigital.com.au/news/tag/steven-de-costa/) **Description:** Articles and insights by Steven de Costa, CKAN Co-steward on data management, open data portals, and digital transformation strategies. --- ### [Constructor Theory](https://linkdigital.com.au/news/tag/constructor-theory/) **Description:** Articles and insights by Steven de Costa, CKAN Co-steward on data management, open data portals, and digital transformation strategies. --- ### [Open Data Barometer](https://linkdigital.com.au/news/tag/open-data-barometer/) **Description:** Open Data Barometer insights, government transparency metrics, and benchmarking strategies for public data accessibility assessment. --- ### [Indigenous knowledge](https://linkdigital.com.au/news/tag/indigenous-knowledge/) --- ### [Canadian Watershed Information Network](https://linkdigital.com.au/news/tag/canadian-watershed-information-network/) --- ### [United Nation's Sustainable Development Goals](https://linkdigital.com.au/news/tag/united-nations-sustainable-development-goals/) --- ### [Indigenous data governance](https://linkdigital.com.au/news/tag/indigenous-data-governance/) --- ### [csv.conf.v9](https://linkdigital.com.au/news/tag/csv-conf-v9/) --- ### [Comprehensive Knowledge Archive Network](https://linkdigital.com.au/news/tag/comprehensive-knowledge-archive-network/) --- ### [Ian Ward](https://linkdigital.com.au/news/tag/ian-ward/) --- ### [Adria Mercader](https://linkdigital.com.au/news/tag/adria-mercader/) --- ### [Open Government Partnership Summit 2025](https://linkdigital.com.au/news/tag/open-government-partnership-summit-2025/) --- ### [Digital public infrastructure](https://linkdigital.com.au/news/tag/digital-public-infrastructure/) --- ### [Open Government Partnership](https://linkdigital.com.au/news/tag/open-government-partnership/) --- ### [Open source technology](https://linkdigital.com.au/news/tag/open-source-technology/) --- ### [Artificial intelligence](https://linkdigital.com.au/news/tag/artificial-intelligence/) --- ### [algorithmic transparency](https://linkdigital.com.au/news/tag/algorithmic-transparency/) --- ### [OGP Summit 2025](https://linkdigital.com.au/news/tag/ogp-summit-2025/) --- ### [Canadian open data movement](https://linkdigital.com.au/news/tag/canadian-open-data-movement/) --- ### [CKAN updates](https://linkdigital.com.au/news/tag/ckan-updates/) --- ### [Objective Observer Initiative](https://linkdigital.com.au/news/tag/objective-observer-initiative/) --- ### [UI/UX design](https://linkdigital.com.au/news/tag/ui-ux-design/) --- ### [geosciences](https://linkdigital.com.au/news/tag/geosciences/) --- ### [CKAN portal](https://linkdigital.com.au/news/tag/ckan-portal/) --- ### [open data and AI](https://linkdigital.com.au/news/tag/open-data-and-ai/) --- ### [CKAN project preparation](https://linkdigital.com.au/news/tag/ckan-project-preparation/) --- ### [vendor lock-in](https://linkdigital.com.au/news/tag/vendor-lock-in/) --- ### [Tome Petrovski](https://linkdigital.com.au/news/tag/tome-petrovski/) --- ### [Ask AI](https://linkdigital.com.au/news/tag/ask-ai/) --- ### [CKAN co-steward](https://linkdigital.com.au/news/tag/ckan-co-steward/) --- ### [CKAN Docker installation](https://linkdigital.com.au/news/tag/ckan-docker-installation/) --- ### [open data management](https://linkdigital.com.au/news/tag/open-data-management/) --- ### [OrbStack](https://linkdigital.com.au/news/tag/orbstack/) --- ### [CKAN 3.0](https://linkdigital.com.au/news/tag/ckan-3-0/) --- ### [Institute of Urban Resilience and Innovation](https://linkdigital.com.au/news/tag/institute-of-urban-resilience-and-innovation/) --- ### [data creation](https://linkdigital.com.au/news/tag/data-creation/) --- ### [data observation](https://linkdigital.com.au/news/tag/data-observation/) --- ### [Tim Berners-Lee](https://linkdigital.com.au/news/tag/tim-berners-lee/) --- ### [Richard Sutton](https://linkdigital.com.au/news/tag/richard-sutton/) --- ### [Personal Online Data Store](https://linkdigital.com.au/news/tag/personal-online-data-store/) --- ### [Solid 2026 Hackathon](https://linkdigital.com.au/news/tag/solid-2026-hackathon/) --- ### [ANU Software Innovation Institute](https://linkdigital.com.au/news/tag/anu-software-innovation-institute/) --- ### [Canberra Innovation Network](https://linkdigital.com.au/news/tag/canberra-innovation-network/) --- ### [Open Data Institute](https://linkdigital.com.au/news/tag/open-data-institute/) --- ### [SOLID protocol](https://linkdigital.com.au/news/tag/solid-protocol/) --- ### [Creative Bureaucracy Festival 2026](https://linkdigital.com.au/news/tag/creative-bureaucracy-festival-2026/) --- ### [trust and democracy](https://linkdigital.com.au/news/tag/trust-and-democracy/) --- ### [Data Dictionaries](https://linkdigital.com.au/news/tag/data-dictionaries/) --- ### [UN Open Source Week](https://linkdigital.com.au/news/tag/un-open-source-week/) --- ### [Managed CKAN hosting](https://linkdigital.com.au/news/tag/managed-ckan-hosting/) --- ### [data sovereignty](https://linkdigital.com.au/news/tag/data-sovereignty/) --- ### [Drupal ugrade](https://linkdigital.com.au/news/tag/drupal-ugrade/) --- ### [Provenance Sandbox](https://linkdigital.com.au/news/tag/provenance-sandbox/) --- ### [verifiable honesty](https://linkdigital.com.au/news/tag/verifiable-honesty/) --- ### [MLCommons Croissant](https://linkdigital.com.au/news/tag/mlcommons-croissant/) --- ### [CKAN upgrade](https://linkdigital.com.au/news/tag/ckan-upgrade/) --- ### [CKAN 2.12](https://linkdigital.com.au/news/tag/ckan-2-12/) --- ### [Bot traffic](https://linkdigital.com.au/news/tag/bot-traffic/) --- ### [data portal security](https://linkdigital.com.au/news/tag/data-portal-security/) --- ### [automated traffic and security](https://linkdigital.com.au/news/tag/automated-traffic-and-security/) --- ### [Drupl](https://linkdigital.com.au/news/tag/drupl/) --- ## Portfolio Categories ### [All case studies](https://linkdigital.com.au/news/portfolio_category/case-studies/) **Description:** Here you will find the collection of case studies presented by Link Digital. These are the projects across industries such as Government/Public Sector, Non-profit/NGO, Environmental/Climate Change, Higher Education and Multilateral organisations. --- ### [AWS](https://linkdigital.com.au/news/portfolio_category/aws/) **Description:** Link Digital is an AWS certified partner. If you are looking for an AWS expert for your digital infrastructure, partner with Link Digital to ensure reliability, scalability, and inexpensive cloud computing services for your organisation. --- ### [CKAN](https://linkdigital.com.au/news/portfolio_category/ckan/) **Description:** Link Digital is recognised as the trusted CKAN partner of governments, NGOs, and multilateral organisations worldwide. Link Digital has been maintaining CKAN for a decade now; they are major contributors and maintainers of the open source project, and half of the CKAN core tech team are from Link Digital. --- ### [Drupal](https://linkdigital.com.au/news/portfolio_category/drupal/) **Description:** Link Digital has built sites based on Drupal. They use Drupal along with CKAN, the open source data management system, with many open data portals worldwide. --- ### [Managed Hosting](https://linkdigital.com.au/news/portfolio_category/managed-hosting/) **Description:** Enterprise-grade infrastructure forms the foundation of Link Digital’s Managed hosting. They ensure consistent performance, high availability, and rapid scalability. --- ### [Application Development](https://linkdigital.com.au/news/portfolio_category/application-development/) **Description:** Over a decade, Link Digital has developed a solid expertise in building custom, built-to-specification online applications based on CKAN and Drupal. --- ### [Product Development](https://linkdigital.com.au/news/portfolio_category/product-development/) **Description:** For over 20 years, Link Digital has developed solid expertise in building custom, built-to-specification online applications based on CKAN and Drupal. From product concept to research, iterative design & development to continuous improvement. --- ### [Azure](https://linkdigital.com.au/news/portfolio_category/azure/) **Description:** Azure is Microsoft’s cloud computing platform. Link Digital utilizes it to host open data platforms and enterprise data solutions using CKAN – software used to power internal data catalogues and public facing data portals that makes it easy for organisations to publish, share and work with data. --- ### [Industry](https://linkdigital.com.au/news/portfolio_category/industry-case-studies/) **Description:** Link Digital works with Government/Public Sector, Non-profit/NGO, Environmental/Climate Change, Higher Education and Multilateral organisations in building data hubs and open data portals based on open source technologies like CKAN and Drupal. --- ### [Government/Public Sector](https://linkdigital.com.au/news/portfolio_category/government-public-sector/) **Description:** Link Digital has partnered with Government/Public Sector in building open data portals. Access the the case studies to see the projects they’ve worked on. --- ### [Higher Education/Research](https://linkdigital.com.au/news/portfolio_category/academia/) **Description:** Link Digital has partnered with organisations that focus on academic and research institutions. Browse the case studies to see the internal data hubs and open data portal projects they’ve worked on. --- ### [Technology Infrastructure](https://linkdigital.com.au/news/portfolio_category/techn-infrastructure/) **Description:** Link Digital are AWS and Azure experts; these are cloud computing platforms that provide a wide array of services for computing, storage, databases, networking, analytics, and machine learning (ML). Link Digital is recognised as the trusted CKAN expert by public sector entities and large organisations worldwide. They build open data portals and internal data hubs. Link Digital is a Drupal expert. They build the sites for Cancer Australia, New South Wales’ Vehicle Emission Star Rating project and more. --- ### [Non-profit/NGO](https://linkdigital.com.au/news/portfolio_category/non-profit-ngo/) **Description:** Link Digital has partnered with nonprofit organisations and NGOs. They are experts in building CKAN-based data hubs and open data portals. --- ### [Environmental/Climate Change](https://linkdigital.com.au/news/portfolio_category/environmental-or-climate-change/) **Description:** Link Digital has partnered with organisations that work on environmental or climate change advocacy. They are experts in building climate data hubs for governments, NGOs, and research organisations. --- ### [Multilateral organisations](https://linkdigital.com.au/news/portfolio_category/multilateral/) **Description:** LinkDigital has partnered with multilateral organisations that require open data portals. Link Digital are experts in building CKAN-based data hubs. --- ### [Capabilities](https://linkdigital.com.au/news/portfolio_category/capabilities/) **Description:** See the case studies that shows Link Digital’s capabilities, from application development, CKAN consulting to CKAN end-to-end professional services, CKAN migration, internal data management, open data portals to product development. --- ### [End to end CKAN Services](https://linkdigital.com.au/news/portfolio_category/end-to-end-ckan-services/) **Description:** Link Digital provide CKAN consultancy, migration, support, maintenance, and developer resources. Link Digital is your go-to partner for any CKAN requirement you need. --- ### [CKAN Migration](https://linkdigital.com.au/news/portfolio_category/ckan-migration/) **Description:** Full-service migration: from planning, metadata cleanup with zero downtime. Link Digital is your go-to partner when migrating from your legacy data management system to open source data management system like CKAN. --- ### [Open data portal](https://linkdigital.com.au/news/portfolio_category/open-data-portal/) **Description:** Link Digital can build CKAN-based data hubs & open data portals. Choose Link Digital as your partner for CKAN-driven data success in your organisation. --- ### [Internal data hub](https://linkdigital.com.au/news/portfolio_category/internal-data-hub/) **Description:** The security of a CKAN internal data management platform can be further enhanced by engaging a third-party service provider, such as Link Digital and by adopting effective data governance and other best practices within the host organisation. --- ### [Region](https://linkdigital.com.au/news/portfolio_category/region/) --- ### [Asia and the Pacific](https://linkdigital.com.au/news/portfolio_category/asia-and-the-pacific/) --- ### [Australia and New Zealand](https://linkdigital.com.au/news/portfolio_category/australia-and-new-zealand/) --- ### [Europe](https://linkdigital.com.au/news/portfolio_category/europe/) --- ### [Canada](https://linkdigital.com.au/news/portfolio_category/canada/) --- ### [South America](https://linkdigital.com.au/news/portfolio_category/south-america/) --- ## Portfolio Tags ### [waterhub](https://linkdigital.com.au/news/portfolio_tag/waterhub/) --- ### [case study](https://linkdigital.com.au/news/portfolio_tag/case-study/) --- ### [living lakes canada](https://linkdigital.com.au/news/portfolio_tag/living-lakes-canada/) --- ### [Drupal](https://linkdigital.com.au/news/portfolio_tag/drupal/) --- ### [open data portal](https://linkdigital.com.au/news/portfolio_tag/open-data-portal/) --- ### [CKAN](https://linkdigital.com.au/news/portfolio_tag/ckan/) --- ### [Government](https://linkdigital.com.au/news/portfolio_tag/government/) --- ### [Government Data Portal](https://linkdigital.com.au/news/portfolio_tag/government-data-portal/) ---