AnchorCrafter
A 2D video generation system based on diffusion model to achieve human-computer interaction animation.
0
- -HOI Appearance Perception: By fusing multi perspective object features and combining them with character reference features, better decoupling results can be achieved.
- -HOI Motion Injection: Control motion by reweighting the training targets in the HOI region to enhance the learning of object details.
- -High visual fidelity: The generated video has high definition and maintains the realism of characters and objects.
- -Controllable interaction: Users can control the interactive actions of characters and objects in the video.
- -Multi perspective object feature fusion: Extracting object features from different perspectives to improve the accuracy of object recognition.
- -Human object dual adapter: Combining character and object features to achieve more refined human object interaction animations.
- -Re weighting of training objectives: Enhance the training objectives in the HOI region to improve the learning effect of object details.
Product Details
AnchorCrafter is an innovative diffusion modeling system designed to generate 2D videos containing target characters and customized objects, achieving high visual fidelity and controllable interaction through the integration of human object interaction (HOI). The system enhances the ability to recognize the appearance of objects from any multiple perspectives through HOI appearance perception, and separates the appearance of people and objects; HOI motion injection achieves complex human object interaction by overcoming the challenges of object trajectory conditions and mutual occlusion management. In addition, reweighting the loss in the HOI region as the training objective enhances the learning of object details. This technology not only maintains the appearance and shape awareness of objects, but also maintains the consistency of character appearance and movement, which is of great significance for fields such as online commerce, advertising, and consumer participation.
