While parsing some pages, I am getting a java.lang.StackOverflowError exception due to the recursion in HTMLMetaProcessor.getMetaTagsHelper. I'm pasting part of the stack trace below. Unfortunately, I've logic that deletes the segment if fetch/parse fails, so I do not know which particular web page caused this problem; I'll recrawl the same pages with modified logic (that does not delete the segment on failed parsing) and try to find the offending URL.
Did anyone encounter such a problem before? Apart from increasing the stack size for Java, is there any other possible solution?
