14th February, 2024

In the continuing absence of single, global identification and transaction messaging standards, the challenges of managing reference data are many and varied, since every data point may be subject to multiple interpretations - and indeed uses - in different contexts.
This blog highlights a discussion point from our comprehensive eBook: “Reference Data: The Essential Guide”.
In the continuing absence of single, global identification and transaction messaging standards, the challenges of managing and normalising reference data are many and varied, since every data point may be subject to multiple interpretations - and indeed uses - in different contexts.
Effective data management is further challenged by a new, post-pandemic home working model that has created a whole new set of data destinations and consumers, with attendant timeliness, security and compliance obligations.
So what are the key challenges to unravelling the reference data Gordian knot?
Specifically, the absence of consistency in how data is collected, stored, and used across different organisations and industries, and the lack of clear definitions and processes for recording data or variations in regulations and requirements for different markets and jurisdictions. Even within an organisation, multiple data sources may lead to inconsistencies.
Managing the large and complex volumes of data. In addition to managing the volume and complexity of data capture, reference data also includes multiple layers of detail with respect to the type of asset, location, currency and counterparty, all of which must be correctly identified, categorised and maintained for use in their respective messaging field.
Another crucial challenge, particularly in the current global economy, is the cost and resources necessary to capture and manage reference data effectively and efficiently, and to implement appropriate data quality control, and validation checks and balances throughout the data lifecycle.
Technology challenges may also hamper efficient consolidation of data sets from multiple sources, systems and formats. Internal data management systems must constantly adapt and flex to accommodate growing data volumes, efficient distribution to multiple end points and real-time approvals, with associated system security and robustness checks and protocols.
Regardless of the costs, complexities and challenges, financial firms have no option but to grasp the data management mettle with respect to ongoing investment in resources, processes and technologies that support greater transparency, operational efficiency and regulatory compliance.
In today’s regulatory-heavy financial markets ecosystem, it is more important than ever for financial firms to implement an efficient and effective data management strategy that optimises data sourcing and delivery efficiency, while mitigating any points of failure on its journey from sources to end destinations.
To find out more about reference data trends and challenges, download our comprehensive eBook “Reference Data: The Essential Guide”.
31st July, 2026
The structure of perpetual contracts makes them better suited to retail traders than the commercial hedgers and institutions that dominate conventional futures markets, according to research.
Zak Jakubowski

31st July, 2026
The New York-headquartered trade analytics company said the latest changes to its Australian market licence have enabled the extension of its electronic trading workflow, ‘Request-for-quote (RFQe)’, to include Australian-listed futures and options.
Aravind Bulusu

31st July, 2026
The Office of the Attorney General (OAG) of New York is seeking a court order to stop Kalshi’s operations as an ‘unlicensed’ gambling business, alleging it exposes New Yorkers, including those under age 21, to personal and financial risk.
Aravind Bulusu
