The HTML spec says that if the size of any “replaced element” (that’s things like
<object>etc) is not specified, then its size should default to 300px x 150px.
<use>points to a
<path>, rather than a whole SVG image, so it’s size is indeterminate.
Given your use case, you cannot.
CLICK HERE to find out more related problems solutions.