Simple because it takes too long
If you want to limit the candidate objects/lines to only those
that are visible in the current view, you can use a window or
crossing selection to get them, and then do the search, but
when finding connecting lines, I wouldn't consider visiblity in
the current view as a legitimate constraint.
So, if the only way to do it correctly takes too long, then I guess
you are left with two possible choices: Do it correctly, or don't
do it at all.