Evangelos Kalogerakis
Skip Abstract Section
Skip Supplemental Material SectionAbstract
This article presents a method for real-time line drawing of deforming objects. Object-space line drawing algorithms for many types of curves, including suggestive contours, highlights, ridges, and valleys, rely on surface curvature and curvature derivatives. Unfortunately, these curvatures and their derivatives cannot be computed in real-time for animated, deforming objects. In a preprocessing step, our method learns the mapping from a low-dimensional set of animation parameters (e.g., joint angles) to surface curvatures for a deforming 3D mesh. The learned model can then accurately and efficiently predict curvatures and their derivatives, enabling real-time object-space rendering of suggestive contours and other such curves. This represents an order-of-magnitude speedup over the fastest existing algorithm capable of estimating curvatures and their derivatives accurately enough for many different types of line drawings. The learned model can generalize to novel animation sequences and is also very compact, typically requiring a few megabytes of storage at runtime. We demonstrate our method for various types of animated objects, including skeleton-based characters, cloth simulation, and blend-shape facial animation, using a variety of nonphotorealistic rendering styles.
An important component of our system is the use of dimensionality reduction for differential mesh data. We show that Independent Component Analysis (ICA) yields localized basis functions, and gives superior generalization performance to that of Principal Component Analysis (PCA).
Supplemental Material
- Bartlett, M., Movellan, J., and Sejnowski, T. 2002. Face recognition by independent component analysis. IEEE Trans. Neural Netw. 13, 6, 1450--1464. Google Scholar
Digital Library
- Bell, A. J. and Sejnowski, T. J. 1997. The independent components of natural scenes are edge filters. Vision Res. 37, 3327--3338.Google ScholarCross Ref
- Bishop, C. M. 2006. Pattern Recognition and Machine Learning. Springer. Google ScholarDigital Library
- Cao, Y., Faloutsos, P., and Pighin, F. 2003. Unsupervised learning for speech motion editing. In Proceedings of the Symposium on Computer Animation, 225--231. Google ScholarDigital Library
- Cohen-Steiner, D. and Morvan, J.-M. 2003. Restricted Delaunay triangulations and normal cycle. In Proceedings of the Symposium on Computational Geometry, 312--321. Google ScholarDigital Library
- Comaniciu, D. and Meer, P. 2002. Mean shift: A robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24, 5, 603--619. Google ScholarDigital Library
- Comon, P. 1994. Independent component analysis, a new concept? Signal Process. 36, 3, 287--314. Google ScholarDigital Library
- DeCarlo, D., Finkelstein, A., and Rusinkiewicz, S. 2004. Interactive rendering of suggestive contours with temporal coherence. In Proceedings of the International symposium on Non-Photorealistic Animation and Rendering, 15--24. Google ScholarDigital Library
- DeCarlo, D., Finkelstein, A., Rusinkiewicz, S., and Santella, A. 2003. Suggestive contours for conveying shape. ACM Trans. Graphics 22, 3, 848--855. Google ScholarDigital Library
- DeCarlo, D. and Rusinkiewicz, S. 2007. Highlight lines for conveying shape. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering, 63--70. Google ScholarDigital Library
- Diewald, U., Preusser, T., and Rumpf, M. 2000. Anisotropic diffusion in vector field visualization on Euclidean domains and surfaces. IEEE Trans. Visualiz. Comput. Graphs. 6, 2, 139--149. Google ScholarDigital Library
- Eigensatz, M., Sumner, R. W., and Pauly, M. 2008. Curvature-Domain shape processing. In Proceedings of the EuroGraphics Computer Graphics Forum 27, 2, 241--250.Google ScholarCross Ref
- Elber, G. and Cohen, E. 1990. Hidden curve removal for free form surfaces. In Proceedings of the ACM SIGGRAPH Conference, vol. 24. 95--104. Google ScholarDigital Library
- Gooch, B., Sloan, P.-P. J., Gooch, A., Shirley, P., and Riesenfeld, R. 1999. Interactive techincal illustration. In Proceedings of the Symposium on Interactive 3D Graphics and Games. Google ScholarDigital Library
- Goodwin, T., Vollick, I., and Hertzmann, A. 2007. Isophote distance: A shading approach to artistic stroke thickness. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering, 53--62. Google ScholarDigital Library
- Heckbert, P. S. and Garland, M. 1999. Optimal triangulation and quadric-based surface simplification. Comput. Geom. Theory Appl. 14, 49--65. Google ScholarDigital Library
- Hertzmann, A. and Zorin, D. 2000. Illustrating smooth surfaces. In Proceedings of the ACM SIGGRAPH Conference, 517--526. Google ScholarDigital Library
- Hyvärinen, A. 1999. Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Netw. 10, 3, 626--634. Google ScholarDigital Library
- Interrante, V., Fuchs, H., and Pizer, S. 1995. Enhancing transparent skin surfaces with ridge and valley lines. In Proceedings of the 6th Conference on Visualization, 52--59. Google ScholarDigital Library
- James, D. L. and Fatahalian, K. 2003. Precomputing interactive dynamic deformable scenes. ACM Trans. Graphics 22, 3, 879--887. Google ScholarDigital Library
- James, D. L. and Twigg, C. D. 2005. Skinning mesh animations. ACM Trans. Graphics 24, 3, 399--407. Google ScholarDigital Library
- Judd, T., Durand, F., and Adelson, E. 2007. Apparent ridges for line drawing. ACM Trans. Graphics 26, 3, 19. Google ScholarDigital Library
- Kalogerakis, E., Simari, P., Nowrouzezahrai, D., and Singh, K. 2007. Robust statistical estimation of curvature on discretized surfaces. In Proceedings of the Symposium on Geometry Processing, 13--22. Google ScholarDigital Library
- Lee, Y., Markosian, L., Lee, S., and Hughes, J. F. 2007. Line drawings via abstracted shading. ACM Trans. Graphics 26, 3, 18. Google ScholarDigital Library
- Lewis, J. P., Cordner, M., and Fong, N. 2000. Pose space deformation: A unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of the ACM SIGGRAPH Conference, 165--172. Google ScholarDigital Library
- Markosian, L., Kowalski, M. A., Trychin, S. J., Bourdev, L. D., Goldstein, D., and Hughes, J. F. 1997. Real-Time nonphotorealistic rendering. In Proceedings of the ACM SIGGRAPH Conference, 415--420. Google ScholarDigital Library
- Meyer, M., Desbrun, M., Schröder, P., and Barr, A. H. 2002. Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and Mathematics III, 35--57.Google Scholar
- Mohr, A. and Gleicher, M. 2003. Building efficient, accurate character skins from examples. ACM Trans. Graphics 22, 3, 562--568. Google ScholarDigital Library
- Ni, A., Jeong, K., Lee, S., and Markosian, L. 2006. Multi-Scale line drawings from 3D meshes. In Proceedings of the International Symposium on 3D Data Processing, Visualization and Transmission, 133--137. Google ScholarDigital Library
- Nocedal, J. and Wright, S. J. 1999. Numerical Optimization. Springer-Verlag.Google Scholar
- Northrup, J. D. and Markosian, L. 2000. Artistic silhouettes: A hybrid approach. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering, 31--38. Google ScholarDigital Library
- Nowrouzezahrai, D., Kalogerakis, E., and Fiume, E. 2009. Shadowing dynamic scenes with arbitrary BRDFs. In Proceedings of the EuroGraphics Conference. To appear.Google Scholar
- Nowrouzezahrai, D., Kalogerakis, E., Simari, P., and Fiume, E. 2008. Shadowed relighting of dynamic geometry with 1d BRDFs. In Proceedings of the EuroGraphics Conference .Google Scholar
- Nowrouzezahrai, D., Simari, P., Kalogerakis, E., Singh, K., and Fiume, E. 2007. Compact and efficient generation of radiance transfer for dynamically articulated characters. In Proceedings of the GRAPHITE Conference, 147--154. Google ScholarDigital Library
- Ohtake, Y., Belyaev, A., and Seidel, H.-P. 2004. Ridge-Valley lines on meshes via implicit surface fitting. ACM Trans. Graphics 23, 3, 609--612. Google ScholarDigital Library
- Pauly, M., Keiser, R., and Gross, M. 2003. Multi-Scale feature extraction on point-sampled surfaces. In Proceedings of EuroGraphics Conference. 281--289.Google Scholar
- Polthier, K. 2002. Polyhedral surfaces of constant mean curvature. Ph.D. thesis, TU-Berlin.Google Scholar
- Rusinkiewicz, S. 2004. Estimating curvatures and their derivatives on triangle meshes. In Proceedings of the International Symposium on 3D Data Processing, Visualization and Transmission, 486--493. Google ScholarDigital Library
- Rusinkiewicz, S. 2007. Trimesh2 library. http://www.cs.princeton.edu/gfx/proj/trimesh2/.Google Scholar
- Rusinkiewicz, S., Burns, M., and DeCarlo, D. 2006. Exaggerated shading for depicting shape and detail. In Proceedings of the ACM SIGGRAPH Conference 25, 3, 1199--1205. Google ScholarDigital Library
- Saito, T. and Takahashi, T. 1990. Comprehensible rendering of 3-D shapes. In Proceedings of the ACM SIGGRAPH Conference , vol. 24, 197--206. Google ScholarDigital Library
- Sloan, P.-P., Kautz, J., and Snyder, J. 2002. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In Proceedings of the ACM SIGGRAPH Conference, 527--536. Google ScholarDigital Library
- Taubin, G. 1995. Estimating the tensor of curvature of a surface from a polyhedral approximation. In Proceedings of the 5th International Conference on Computer Vision. Google ScholarDigital Library
- Thirion, J.-P. and Gourdon, A. 1996. The 3D marching lines algorithm. Graphical Models Image Process. 58, 6, 503--509. Google ScholarDigital Library
- Vergne, R., Barla, P., Granier, X., and Schlick, C. 2008. Apparent relief: A shape descriptor for stylized shading. In Proceedings of the International Symposium on Non-Photorealistic Animation and Rendering. Google ScholarDigital Library
- Wang, R. Y., Pulli, K., and Popović, J. 2007. Real-Time enveloping with rotational regression. ACM Trans. Graphics 26, 3, 73. Google ScholarDigital Library
- Weisberg, S. 2003. Applied Linear Regression, 3rd ed. Wiley/Interscience.Google Scholar
- Winkenbach, G. and Salesin, D. H. 1996. Rendering parametric surfaces in pen and ink. In Proceedings of the ACM SIGGRAPH, Conference. 469--476. Google ScholarDigital Library
- Yoshizawa, S., Belyaev, A., Yokota, H., and Seidel, H.-P. 2007. Fast and faithful geometric algorithm for detecting crest lines on meshes. In Proceedings of the Pacific Graphics Conference, 231--237. Google ScholarDigital Library
- Yu, J., Yin, X., Gu, X., McMillan, L., and Gortler, S. 2007. Focal surfaces of discrete geometry. In Proceedings of the Symposium on Geometry Processing, 23--32. Google ScholarDigital Library
Index Terms
- Data-driven curvature for real-time line drawing of dynamic scenes
Recommendations
Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation
Previous methods for soft shadows numerically integrate over many light directions at each receiver point, testing blocker visibility in each direction. We introduce a method for real-time soft shadows in dynamic scenes illuminated by large, low-...
Real-time soft shadows in dynamic scenes using spherical harmonic exponentiation
SIGGRAPH '06: ACM SIGGRAPH 2006 PapersPrevious methods for soft shadows numerically integrate over many light directions at each receiver point, testing blocker visibility in each direction. We introduce a method for real-time soft shadows in dynamic scenes illuminated by large, low-...
Real-Time Shape Illustration Using Laplacian Lines
This paper presents a novel object-space line drawing algorithm that can depict shapes with view-dependent feature lines in real time. Strongly inspired by the Laplacian-of-Gaussian (LoG) edge detector in image processing, we define Laplacian lines as ...
Comments