Abstract
3D modeling and mesh editing for objects from orthographic projections of engineering drawings have become common and convenient. Designers are accustomed to using simple sketching to express visualized thoughts. This paper presents a method for controlling the deformation of surface meshes by sketching on orthographic projections. The system allows users to select a region of interest (ROI) to constrain the deformation area and then sketch the desired contour. For a given new sketch, the system automatically deforms the 3D model using Laplacian deformation, fitting the model's contours to the user's sketch. Various examples validate the effectiveness of this approach as an intuitive method for 3D model editing.
Introduction
In traditional CAD and engineering workflows, designers frequently communicate ideas through 2D orthographic projections—front, top, and side views. However, editing existing 3D meshes often involves complex tools, vertex manipulation, or dense control cages that can be unintuitive for those used to 2D drafting.
This research bridges the gap between 2D drafting and 3D mesh editing by allowing users to draw 2D strokes directly over flat projections. The primary challenge addressed is translating a single 2D stroke into a smooth, detail-preserving 3D deformation that respects the original geometry while achieving the desired silhouette change.
Methodology
The proposed pipeline consists of four primary stages designed to translate 2D intent into 3D geometry:
- Orthographic Projection & ROI Selection: The 3D mesh is projected onto a 2D plane (xy, xz, or yz). The user defines a rectangular Region of Interest (ROI) to isolate the specific area of the model intended for deformation.
- Sketching the Contour: Within the ROI, the user draws a target contour using freehand strokes or uniform quadratic B-splines.
- Determining Correspondences: The system maps the dense 2D sketch to the 3D mesh vertices by sampling feature points along the sketch based on a distance threshold ($d$). It identifies the nearest projected 3D vertices within the ROI to serve as corresponding constraint points.
- Laplacian Deformation: To preserve local geometric features like surface texture or muscle definition, the system employs Laplacian coordinates. It solves a linear system where junction points between the ROI and the rest of the mesh act as fixed boundary constraints, while mapped vertices from the sketch act as moving constraints. This ensures the global shape matches the sketch while local differential properties are preserved.
Key Insights and Implementation
A critical parameter in this process is the distance threshold ($d$) used for sampling the 2D sketch. This threshold must align with the local grid density of the mesh; if $d$ is too large, the mesh fails to fit the new contour accurately, leading to a loss of shape fidelity.
Furthermore, the use of Laplacian coordinates allows the algorithm to treat the mesh like a flexible sheet. While the global shape stretches to meet the 2D sketch, the local relationships between adjacent vertices—the "details"—are preserved in a least-squares sense. The ROI boundary serves as an implicit blending mechanism, ensuring smooth transitions into the unedited parts of the model without requiring manual weight painting or transition zone definition.
Results and Discussion
The method was evaluated qualitatively using various animal models, such as deer and canines. As shown in the results, users can alter complex postures, such as a deer's neck or a wolf's stance, with simple profile lines. The system successfully updates the 3D mesh to match the new silhouette while maintaining surface smoothness and preserving unedited regions.
While the visual results are promising, performance bottlenecks currently exist. Calculating Laplacian deformations and refreshing projection views in real-time remains a challenge for very dense meshes, which is a key area for optimization.
Conclusion and Future Work
This paper demonstrates an intuitive approach to 3D mesh editing via 2D sketching on orthographic views. Future research will focus on improving computational efficiency for real-time interaction and incorporating depth and occlusion context from user sketches to handle more complex geometry. Additionally, extending the technique to allow direct sketching on 3D surfaces in perspective views could further enhance the flexibility of the designer's workflow.
Summary updated