It sounds like you may need to capture the location of the initial drag action, and do addition or subtraction to determine the offset based from hypeGestureXPosition and hypeGestureYPosition.
There are a few threads on dragging / dropping that might provide code hints for this workflow: Drag and Drop for simple Quiz & the DragDrop tag.