Cannot raycaster fragment

[RyugaRyuzaki]

Describe the bug 📝

From this, https://github.com/ThatOpen/engine_clay/blob/main/src/elements/Elements/Element/index.ts#L66-L72.
There is a problem when raycaster goes to fragment. I am trying to implement this function. It seems to only work the first time with the plane of the RectangularProfile.

As this image, when i hover red region it's ok, but with blue region it's not.
Event i tried :

fragment.mesh.instanceMatrix.needsUpdate = true;
fragment.mesh.matrixWorldNeedsUpdate = true;
fragment.mesh.updateMatrixWorld(true);
fragment.mesh.updateWorldMatrix(true, true);
fragment.mesh.updateMatrix();

Reproduction ▶️

No response

Steps to reproduce 🔢

=========

System Info 💻

=========

Used Package Manager 📦

npm

Error Trace/Logs 📃

No response

Validations ✅

• Read the docs.
• Check that there isn't already an issue that reports the same bug to avoid creating a duplicate.
• Make sure this is a repository issue and not a framework-specific issue. For example, if it's a THREE.js related bug, it should likely be reported to mrdoob/threejs instead.
• Check that this is a concrete bug. For Q&A join our Community.
• The provided reproduction is a minimal reproducible example of the bug.