RTR Text reflow

[philips]

Problem: Recognized text isn't really formatted into paragraphs in a way that is nice for markdown.

Solution: There needs to be some sort of heuristics algorithm to group the bounding boxes (see IRecognitionElement) and text into reflowed text.

How you can help: Please upload simple single page RTR .note files to this issue and include a copy of the text formatted in the way you wish it was formatted so I can generate some test cases.

For example:

Note: rtr.note.zip

Screenshot (optional):

Should output this:

Real time recognition paragraph test

With enough space a new paragraph should be created. If lines are close then the text should reflow.

This should be a new paragraph.

As well as this.

But thin is the last paragraph and should reflow together.

[edfinn1973]

Sorry for the delay, thank you for working on this. Here are a few notes that are already published for you to take a look at. Let me know if I can help.

Supernote System Gaps (03-08-2024).zip

[philips]

I have had a couple of false starts at an algorithm here. The observations so far:

• The label field at the top has all of the text in the right order but no bounding boxes.
• The words field has all of the bounding boxes but the words may be out of order and are hard to reliably sort.

Probably need to make a third attempt here where I trust the label field and then try to build a bounding box around the lines using fuzzy matching from the words fields for each line.

[edfinn1973]

Thank you for your work on this. The new PDF attach is awesome, been working through current notes. Sent from Samsung Galaxy smartphone. Get Outlook for Android<https://aka.ms/AAb9ysg>

…

________________________________ From: Brandon Philips ***@***.***> Sent: Friday, February 7, 2025 9:12:17 PM To: philips/supernote-obsidian-plugin ***@***.***> Cc: edfinn1973 ***@***.***>; Comment ***@***.***> Subject: Re: [philips/supernote-obsidian-plugin] RTR Text reflow (Issue #49) I have had a couple of false starts at an algorithm here. The observations so far: * The label field at the top has all of the text in the right order but no bounding boxes. * The words field has all of the bounding boxes but the words may be out of order and are hard to reliably sort. Probably need to make a third attempt here where I trust the label field and then try to build a bounding box around the lines using fuzzy matching from the words fields for each line. — Reply to this email directly, view it on GitHub<#49 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/BHKDJFYNO7HYOD5UO5WECG32OVYZDAVCNFSM6AAAAABV3QJLPCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMNBUGQ2TQMBSGQ>. You are receiving this because you commented.Message ID: ***@***.***>