Meet TARDIS: An AI Framework that Identifies Singularities in Complex Spaces and Captures Singular Structures and Local Geometric Complexity in Image Data

We are deluged with enormous volumes of data from all the different domains, including scientific, medical, social media, and educational data. Analyzing such data is a crucial requirement. With the increasing amount of data, it is important to have approaches for extracting simple and meaningful representations from complex data. The previous methods work on the same assumption that the data lies close to a small-dimensional manifold despite having a large ambient dimension and seek the lowest-dimensional manifold that best characterizes the data.

Manifold learning methods are used in representation learning, where high-dimensional data is transformed into a lower-dimensional space while keeping crucial data features intact. Though the manifold hypothesis work for most types of data, it doesn’t work well in data with singularities. Singularities are the regions where the manifold assumption breaks down and can contain important information. These regions violate the smoothness or regularity properties of a manifold.

Researchers have proposed a topological framework called TARDIS (Topological Algorithm for Robust DIscovery of Singularities) to address the challenge of identifying and characterizing singularities in data. This unsupervised representation learning framework detects singular regions in point cloud data and has been designed to be agnostic to the geometric or stochastic properties of the data, only requiring a notion of the intrinsic dimension of neighborhoods. It aims to tackle two key aspects – quantifying the local intrinsic dimension and assessing the manifoldness of a point across multiple scales. 

The authors have mentioned that quantifying the local intrinsic dimension measures the effective dimensionality of a data point’s neighborhood. The framework has achieved this by using topological methods, particularly persistent homology, which is a mathematical tool used to study the shape and structure of data across different scales. It estimates the intrinsic dimension of a point’s neighborhood by applying persistent homology, which gives information on the local geometric complexity. This local intrinsic dimension measures the degree to which the data point is manifold and indicates whether it conforms to the low-dimensional manifold assumption or behaves differently.

The Euclidicity Score, which evaluates a point’s manifoldness on different scales, quantifies a point’s departure from Euclidean behavior, revealing the existence of singularities or non-manifold structures. The framework captures differences in a point’s manifoldness by taking Euclidicity into account at various scales, making it possible to spot singularities and comprehend local geometric complexity.

The team has provided theoretical guarantees on the approximation quality of this framework for certain classes of spaces, including manifolds. They have run experiments on a variety of datasets, from high-dimensional image collections to spaces with known singularities, to validate their theory. These findings showed how well the approach identifies and processes non-manifold portions in data, shedding light on the limitations of the manifold hypothesis and exposing important data hidden in singular regions.

In conclusion, this approach effectively questions the manifold hypothesis and is efficient in detecting singularities which are the points that violate the manifoldness assumption.

Check Out The Paper and Github link. Don’t forget to join our 24k+ ML SubReddit, Discord Channel, and Email Newsletter, where we share the latest AI research news, cool AI projects, and more. If you have any questions regarding the above article or if we missed anything, feel free to email us at [email protected]

🚀 Check Out 100’s AI Tools in AI Tools Club