TL;DR: This work employs an automatic clustering method to generate field-line templates for the user to locate subfields of interest and leverages the user's knowledge about the flow field through intuitive user interaction, resulting in a promising alternative to existing flow visualization solutions.
Abstract: In flow visualization, field lines are often used to convey both global and local structure and movement of the flow. One challenge is to find and classify the representative field lines. Most existing solutions follow an automatic approach that generates field lines characterizing the flow and arranges these lines into a single picture. In our work, we advocate a user-centric approach to exploring 3D vector fields. Our method allows the user to sketch 2D curves for pattern matching in 2D and field lines clustering in 3D. Specifically, a 3D field line whose view-dependent 2D projection is most similar to the user drawing will be identified and utilized to extract all similar 3D field lines. Furthermore, we employ an automatic clustering method to generate field-line templates for the user to locate subfields of interest. This semi-automatic process leverages the user's knowledge about the flow field through intuitive user interaction, resulting in a promising alternative to existing flow visualization solutions. With our sketch-based interface, the user can effectively dissect the flow field and make more structured visualization for analysis or presentation.
Flow visualization is relevant to many areas of science and engineering from understanding the evolution of universe, analyzing weather patterns, to designing more efficient engines for cars.
One area of flow visualization can use more innovations is visualization of 3D vector fields.
Among different solutions to this problem, automatic clustering plays a vital role towards effective understanding of the flow patterns.
The first category is based on voxel-wise analysis which classifies similar contiguous vectors so that the whole vector field can be divided into several cluster regions.
Several methods can be used to represent field lines and measure the similarity between them.
2 RELATED WORK
One of the most important goals in flow visualization is to display the vector field in a clear and meaningful way, in which flow characteristics are carefully presented and thus can be easily perceived.
Li et al. [7] also introduced another method for streamline placement which is different from [8] in that its goal is to generate representative and illustrative streamlines in 2D vector fields to enforce visual clarity and evidence.
Clustering is another key technique to generate meaningful visualization for representing complex flow patterns.
Heckel et al. [6] introduced a top-down clustering method by splitting groups of voxels iteratively.
O’Donnell et al. [13] utilized the symmetrized Hausdorff distance as the similarity measurement among trajectories and achieved spectral clustering using the Nyström method and the k-means algorithm in the embedding space.
3 OVERVIEW
Figure 1 illustrates the flowchart of their vector field sketching and clustering process.
The approach introduces user interaction into the clustering.
The authors assume that they are given enough field lines that could capture as many features as possible in the vector field.
The authors point out that their method can work with existing seeding strategies that capture different aspects of flow features.
The resulting field lines may provide valuable information for purposeful sketching.
3.1 Sketching for Field Line Clustering
For field line clustering, their approach includes two steps: 2D curve selection [22, 2] and similar 3D field lines clustering [14].
Based on these projected curves, the authors utilize the string matching approach to find the field line that is most similar to the input.
The only difference is that one 3D curve should be represented by both curvature and torsion.
After a few iterations, the entire vector filed would be partitioned into different clusters.
Alternatively, representative field lines from each group can be used for selective display so that a less cluttered visualization can be realized while distinct flow patterns are exhibited.
3.2 Sketching for Template Query
For field line template query, a list of clusters is pre-generated using a hierarchical clustering algorithm during preprocessing.
The algorithm allows the user to change the number of clusters interactively at runtime.
This similarity comparison helps narrow down a potentially large number of templates to only a few most similar ones for user selection.
As the user keeps drawing the pattern, the template reordering becomes more accurate.
The user can simply select one from the filtered template list anytime during her drawing and the corresponding filed line cluster will be highlighted in the display.
4.1 Representation of 2D User Sketching
A meaningful representation of the input drawing is required for the following 2D curve selection and 3D curve clustering.
In Figure 2(a), the angular difference at the first four points are positive and those at the last three points are negative since the proceeding direction of the curve changes from counterclockwise to clockwise.
However there is still one problem remaining.
According to this feature generation method, different field lines would have different numbers of curvatures in the feature representation.
4.2 Matching 2D Field Line Projections
In their system, the user can observe the vector field from different points of view.
At a certain viewing direction, the user may find some pattern she is interested in and she can sketch this curve pattern in the given 2D interface.
The system will find similar field line projections in the 2D space under the current view.
4.2.1 String Matching
The authors use the string matching approach to find similar curves based on the user’s input.
To measure the difference between strings, the authors employ the edit distance.
For the 2D curve representation, every primitive vector composing one string is only one-dimensional which is the curvature.
The reference curve will be the user’s sketching and all the other lines will be matched accordingly to identify the most similar one.
One critical issue with string matching is the definition of the cost function.
4.2.2 Repetition, Scale, and Tolerance in Patterns
If streamlines are traced very long due to the underlying flow pattern, the total length and angle changes of each field line can be very large.
According to the angle changes along the curve, only sample points at which the absolute value of total angle change is less than a certain value are considered.
The change of scales for certain flow patterns is an important aspect and should be taken into consideration in curve matching as well.
In some cases, flow patterns of small size are just noise, but in others, they are probably important areas in the vector field.
This also makes it possible to show how different groups of field lines are similar to each other as the tolerance parameter varies.
4.3 Matching 3D Field Lines
Only matching curves in 2D does not complete their work because similar field lines in 3D are likely to have quite different shapes after projected onto the 2D viewing plane.
The authors goal is to find all similar field lines, and therefore, the authors need to classify field lines in the 3D space.
The authors point out that the 2D curve matching method can be extended to 3D.
In 3D, a curve can be uniquely represented by its curvature and torsion while in 2D, using only the curvature information suffices.
The curvature and torsion at each sample point can be organized into a two-dimensional vector, which serves as a primitive in string matching.
5 SKETCH-BASED TEMPLATE QUERY
For automatic clustering, the authors use a typical agglomerative hierarchical clustering method.
All the initial field lines are stored in the leaf nodes.
When merging two clusters into a new one, the representative string for the new cluster is the mean string of the merged clusters.
Then, the selected clusters are displayed using the projections of their representative field lines.
The authors first sample the 2D projection of the field line, and then accumulate the angles of the two consecutive sample line segments, where a larger angle represents more information shown in the 2D projection and therefore a higher viewpoint quality.
6.1 Results
The authors experimented with their user-centric approach on several flow data sets.
The first one is the velocity vector field of the hurricane Isabel data set, provided by the National Science Foundation and the National Center for Atmospheric Research (NCAR).
The third one is the flow field in a computer room.
Clearly, all rendered images contain a great deal of clutter.
In the following, the authors demonstrate how their sketch-based interface helps the users specify line patterns and cluster the flow fields.
6.1.1 Sketch-Based Clustering and Template Query
Examples of the user sketching and the matching streamlines are displayed in Figure 5 (a) and Figure 6 (a) for the hurricane and computer room data sets, respectively.
The experiments show that their 2D pattern matching and 3D streamline clustering algorithm work pretty well for different kinds of patterns: straight or curved, long or short.
The user can draw close to what have been observed and similar streamlines will be displayed interactively.
This ability is very useful for exploring a complex flow data and isolating one interesting cluster at a time.
The authors system dynamically identifies the most similar templates as the user sketches the pattern on the fly.
6.1.2 Scale and Similarity Threshold Control
Streamlines sharing the similar shape may have different scales.
To allow the user to explore the scale, the authors provide a slider where the user can change the magnitude threshold to brush similar streamlines at different scales.
Figure 7 shows examples with the three data sets.
This capability is useful as the user may pay attention to larger scale features first and then focuses on smaller scale features in local regions.
As the user varies the tolerance value, she can have an intuitive understanding of how streamlines with different degrees of similarity differ from each other and how they are distributed over the space.
6.1.3 Visualization of Multiple Clusters
In their system, the user can iteratively explore the flow data and brush the streamlines to identify multiple clusters in order.
Once the user is satisfied with her exploration results, the system can display multiple clusters with different color, opacity, or rendering styles to differentiate them.
The authors can also selectively display a subset of streamlines from each cluster for a less cluttered view.
Figure 9 shows these visualizations with the three data sets, respectively.
Compared with the original rendering with all streamlines displayed, Figure 9 demonstrates that the authors can now generate a clearer and more meaningful picture to reveal the different flow patterns.
6.2 Discussion
During the preprocessing, the authors trace a large number of field lines from the input vector field.
The authors then parameterize these field lines using the B-spline.
The algorithm accepts fuzzy input in the sense that the user can sketch patterns close to field line 2D projections.
Another aspect that needs improvement is the cost function for string matching.
For a better similarity matching, the cost function should be adaptive to the characteristics of the flow fields.
7 CONCLUSIONS
Three-dimensional vector field visualization stays a challenging problem.
The sketch-based technique the authors have introduced complements existing methods by offering a new way to probe and dissect a flow field.
It dictates a user centered and domain knowledge directed process, which the authors believe is key to the understanding of large and complex flow fields.
For further work, the authors will involve scientists in the evaluation of their technique.
In particular, sketching and brushing may be done creatively and quite naturally through touch and stereoscopic interfaces.
TL;DR: An overview of the existing illustrative techniques for flow visualization is given, which problems have been solved and which issues still need further investigation are highlighted, and remarks and insights on the current trends in illustrative flow visualization are provided.
Abstract: Flow visualization is a well established branch of scientific visualization and it currently represents an invaluable resource to many fields, like automotive design, meteorology and medical imaging. Thanks to the capabilities of modern hardware, flow datasets are increasing in size and complexity, and traditional flow visualization techniques need to be updated and improved in order to deal with the upcoming challenges. A fairly recent trend to enhance the expressiveness of scientific visualization is to produce depictions of physical phenomena taking inspiration from traditional handcrafted illustrations: this approach is known as illustrative visualization, and it is getting a foothold in flow visualization as well. In this state of the art report we give an overview of the existing illustrative techniques for flow visualization, we highlight which problems have been solved and which issues still need further investigation, and, finally, we provide remarks and insights on the current trends in illustrative flow visualization.
TL;DR: FlowNet is presented, a single deep learning framework for clustering and selection of streamlines and stream surfaces generated from a flow field data set and which employs an autoencoder to learn their respective latent feature descriptors.
Abstract: For effective flow visualization, identifying representative flow lines or surfaces is an important problem which has been studied. However, no work can solve the problem for both lines and surfaces. In this paper, we present FlowNet, a single deep learning framework for clustering and selection of streamlines and stream surfaces. Given a collection of streamlines or stream surfaces generated from a flow field data set, our approach converts them into binary volumes and then employs an autoencoder to learn their respective latent feature descriptors. These descriptors are used to reconstruct binary volumes for error estimation and network training. Once converged, the feature descriptors can well represent flow lines or surfaces in the latent space. We perform dimensionality reduction of these feature descriptors and cluster the projection results accordingly. This leads to a visual interface for exploring the collection of flow lines or surfaces via clustering, filtering, and selection of representatives. Intuitive user interactions are provided for visual reasoning of the collection with ease. We validate and explain our deep learning framework from multiple perspectives, demonstrate the effectiveness of FlowNet using several flow field data sets of different characteristics, and compare our approach against state-of-the-art streamline and stream surface selection algorithms.
65 citations
Cites methods from "A sketch-based interface for classi..."
...Arnold-Beltrami-Childress (ABC) incompressible flow which is an exact solution of Euler’s equation [30], the liquid flow between two parallel planes [31], the air flow around a car [1], the air flow in a computer room [32], the heat flow around a cooking crayfish [1], a synthesized flow field consisting of five critical points [33], the compressible downflow solar plume [34], the flow around a confined square cylinder [35], the flow of core-collapse supernovae [36], a procedurally generated tornado [37], and swirls resulting...
TL;DR: This paper introduces a technique to interpret a user's drawings with an interactive, nonlinear axis mapping approach called AxiSketcher, which enables users to impose their domain knowledge on a visualization by allowing interaction with data entries rather than with data attributes.
Abstract: Visual analytics techniques help users explore high-dimensional data. However, it is often challenging for users to express their domain knowledge in order to steer the underlying data model, especially when they have little attribute-level knowledge. Furthermore, users' complex, high-level domain knowledge, compared to low-level attributes, posits even greater challenges. To overcome these challenges, we introduce a technique to interpret a user's drawings with an interactive, nonlinear axis mapping approach called AxiSketcher. This technique enables users to impose their domain knowledge on a visualization by allowing interaction with data entries rather than with data attributes. The proposed interaction is performed through directly sketching lines over the visualization. Using this technique, users can draw lines over selected data points, and the system forms the axes that represent a nonlinear, weighted combination of multidimensional attributes. In this paper, we describe our techniques in three areas: 1) the design space of sketching methods for eliciting users' nonlinear domain knowledge; 2) the underlying model that translates users' input, extracts patterns behind the selected data points, and results in nonlinear axes reflecting users' complex intent; and 3) the interactive visualization for viewing, assessing, and reconstructing the newly formed, nonlinear axes.
65 citations
Cites methods from "A sketch-based interface for classi..."
...Sketching has also been used to generate vector fields, allowing users to draw streamlines and quickly simulate fluid flows [40, 50]....
TL;DR: This work develops a Lagrangian framework for the comparison of flow fields in an ensemble and introduces a classification space that facilitates incorporation of these properties into a common ensemble visualization.
Abstract: Sets of simulation runs based on parameter and model variation, so-called ensembles, are increasingly used to model physical behaviors whose parameter space is too large or complex to be explored automatically. Visualization plays a key role in conveying important properties in ensembles, such as the degree to which members of the ensemble agree or disagree in their behavior. For ensembles of time-varying vector fields, there are numerous challenges for providing an expressive comparative visualization, among which is the requirement to relate the effect of individual flow divergence to joint transport characteristics of the ensemble. Yet, techniques developed for scalar ensembles are of little use in this context, as the notion of transport induced by a vector field cannot be modeled using such tools. We develop a Lagrangian framework for the comparison of flow fields in an ensemble. Our techniques evaluate individual and joint transport variance and introduce a classification space that facilitates incorporation of these properties into a common ensemble visualization. Variances of Lagrangian neighborhoods are computed using pathline integration and Principal Components Analysis. This allows for an inclusion of uncertainty measurements into the visualization and analysis approach. Our results demonstrate the usefulness and expressiveness of the presented method on several practical examples.
64 citations
Cites background from "A sketch-based interface for classi..."
...Similarities can then be defined by the presence or absence of common feature types, shapes, or properties (see for example [32, 19] for feature based similarity metrics in flow fields)....
TL;DR: A novel energy minimization formulation in which both geometric and temporal information from digital input devices is used to define stroke‐to‐stroke and scribble‐to-stroke relationships is introduced.
TL;DR: An algorithm is presented which solves the string-to-string correction problem in time proportional to the product of the lengths of the two strings.
Abstract: The string-to-string correction problem is to determine the distance between two strings as measured by the minimum cost sequence of “edit operations” needed to change the one string into the other. The edit operations investigated allow changing one symbol of a string into another single symbol, deleting one symbol from a string, or inserting a single symbol into a string. An algorithm is presented which solves this problem in time proportional to the product of the lengths of the two strings. Possible applications are to the problems of automatic spelling correction and determining the longest subsequence of characters common to two strings.
3,252 citations
"A sketch-based interface for classi..." refers background in this paper
...Theedit distance, introduced by Wagner and Fisher [21], is a metric for measuring the amount of difference between two sequences....
TL;DR: Modern Differential Geometry of Curves and Surfaces with Mathematica explains how to define and compute standard geometric functions, for example the curvature of curves, and presents a dialect ofMathematica for constructing new curves and surfaces from old.
Abstract: From the Publisher:
The Second Edition combines a traditional approach with thesymbolic manipulation abilities of Mathematica to explain and develop the classical theory of curves and surfaces. You will learn to reproduce and study interesting curves and surfaces - many more than are included in typical texts - using computer methods. By plotting geometric objects and studying the printed result, teachers and students can understand concepts geometrically and see the effect of changes in parameters.
Modern Differential Geometry of Curves and Surfaces with Mathematica explains how to define and compute standard geometric functions, for example the curvature of curves, and presents a dialect of Mathematica for constructing new curves and surfaces from old. The book also explores how to apply techniques from analysis.
Although the book makes extensive use of Mathematica, readers without access to that program can perform the calculations in the text by hand. While single- and multi-variable calculus, some linear algebra, and a few concepts of point set topology are needed to understand the theory, no computer or Mathematica skills are required to understand the concepts presented in the text. In fact, it serves as an excellent introduction to Mathematica, and includes fully documented programs written for use with Mathematica.
Ideal for both classroom use and self-study, Modern Differential Geometry of Curves and Surfaces with Mathematica has been tested extensively in the classroom and used in professional short courses throughout the world.
TL;DR: This survey reviews and classify geometric flow visualization literature according to the most important challenges when considering such a visualization, a central theme being the seeding algorithm upon which they are based.
Abstract: Flow visualization is a fascinating sub-branch of scientific visualization. With ever increasing computing power, it is possible to process ever more complex fluid simulations. However, a gap between data set sizes and our ability to visualize them remains. This is especially true for the field of flow visualization which deals with large, timedependent, multivariate simulation datasets. In this paper, geometry based flow visualization techniques form the focus of discussion. Geometric flow visualization methods place discrete objects in the vector field whose characteristics reflect the underlying properties of the flow. A great amount of progress has been made in this field over the last two decades. However, a number of challenges remain, including placement, speed of computation, and perception. In this survey, we review and classify geometric flow visualization literature according to the most important challenges when considering such a visualization, a central theme being the seeding object upon which they are based. This paper details our investigation into these techniques with discussions on their applicability and their relative merits and drawbacks. The result is an up-to-date overview of the current state-of-the-art that highlights both solved and unsolved problems in this rapidly evolving branch of research. It also serves as a concise introduction to the field of flow visualization research.
300 citations
"A sketch-based interface for classi..." refers background in this paper
...A key issue that affects the quality of streamlines representation is the seeding strategy and streamlines placement [11] because straightforward solutions would easily lead to clutter....
TL;DR: Two algorithms to find the longest common subcurve of two 2D curves are presented, based on conversion of the curves into shape signature strings and application of string matching techniques to find long matching substrings, followed by direct curve matching of the corresponding candidate subcurves to finding the longest matching subCurve.
Abstract: Two algorithms to find the longest common subcurve of two 2D curves are presented. These algorithms are based on conversion of the curves into shape signature strings and application of string matching techniques to find long matching substrings, followed by direct curve matching of the corresponding candidate subcurves to find the longest matching subcurve. The first algorithm is of complexity O(n), where n is the number of sample points on the curves. The second one, while being theoretically somewhat less efficient, proved to be robust and efficient in practical applications. Both algorithms solve the problem of general curves without being dependent on some set of special points on the curves. The algorithms have industrial applications to problems of object assembly and object recognition. Experimental results are included. The algorithms can be easily extended to the 3D case. >
243 citations
"A sketch-based interface for classi..." refers methods in this paper
...For field line clustering, our approach includes two steps: 2D curve selection [22, 2] and similar 3D field lines clustering [14]....
TL;DR: A simple and yet effective method for pairwise comparison of fiber traces is presented which in combination with the N cut criterion is shown to produce plausible segmentations of both synthetic and real fiber trace data.
Abstract: In this paper we present a framework for unsupervised segmentation of white matter fiber traces obtained from diffusion weighted MRI data. Fiber traces are compared pairwise to create a weighted undirected graph which is partitioned into coherent sets using the normalized cut (Ncut) criterion. A simple and yet effective method for pairwise comparison of fiber traces is presented which in combination with the Ncut criterion is shown to produce plausible segmentations of both synthetic and real fiber trace data. Segmentations are visualized as colored stream-tubes or transformed to a segmentation of voxel space, revealing structures in a way that looks promising for future explorative studies of diffusion weighted MRI data.
226 citations
"A sketch-based interface for classi..." refers methods in this paper
...[1] compared pairwise fiber traces in dimension-reduced Euclidean feature space to create a weighted, undirected graph which is partitioned into coherent sets using the normalized cut....
Q1. What are the contributions in "A sketch-based interface for classifying and visualizing vector fields" ?
In their work, the authors advocate a user-centric approach to exploring 3D vector fields. Furthermore, the authors employ an automatic clustering method to generate field-line templates for the user to locate subfields of interest. This semi-automatic process leverages the user ’ s knowledge about the flow field through intuitive user interaction, resulting in a promising alternative to existing flow visualization solutions.
Q2. What have the authors stated for future works in "A sketch-based interface for classifying and visualizing vector fields" ?
For further work, the authors will involve scientists in the evaluation of their technique. To support real-world applications, the technique must be extended to handle time-varying vector fields, that is to extract and track complex flow features over time. The authors will also develop advanced interfaces and interaction techniques for such a user centric approach to flow visualization. In particular, sketching and brushing may be done creatively and quite naturally through touch and stereoscopic interfaces.