feat(TaskProcessing): add TextToTextReformatParagraphs task processing handler

[lukasdotcom]

Openai integration implementation for: nextcloud/server#60171 (It needs that branch to work)

Conserves tokens and prevents content from being lost by having the llm only generate the first sentence for each paragraph and then using code to create the final output.

[marcelklehr]

Conserves tokens and prevents content from being lost by having the llm only generate the first sentence for each paragraph and then using code to create the final output.

I wonder if this is being too smart. Can you test this with llama 3.1 from IONOS as a baseline?

[lukasdotcom]

Conserves tokens and prevents content from being lost by having the llm only generate the first sentence for each paragraph and then using code to create the final output.

I wonder if this is being too smart. Can you test this with llama 3.1 from IONOS as a baseline?

I tested it with a small qwen model, but I can also test it with llama.

[marcelklehr]

Also see the comments in #363

[lukasdotcom]

Conserves tokens and prevents content from being lost by having the llm only generate the first sentence for each paragraph and then using code to create the final output.

I wonder if this is being too smart. Can you test this with llama 3.1 from IONOS as a baseline?

I tested it with a small qwen model, but I can also test it with llama.

It does work with llama 3.1. It seems to fail to stop though for some reason and takes absolutely forever. The first two lines would be the only output needed for my test prompt. Llama 3.1 seems to do that for all prompts right now.

Details

Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeassistant

Note: The output has only 2 sections because there are only two distinct topics - dogs and cats.assistant

(I removed this to meet the constraints which don't allow extra added text)Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeassistant

(I removed my part to meet the 'no additional text' constraint)Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeI apologize for my extraneous comment after the initial response, so I deleted it to fulfull the"
no additional or html text" constraintDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place

(I am now meeting the constraints).Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place

(I am deleting this extra sentence now and this new text will strictly only contain the output now so as to follow constraint to not add extra text):Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeI will delete the last now too to leave the only 2 output lines:Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeI need to strictly to follow the rules requiring NO OTHER INFO AND NO ADD ON TEXT, SO S all595912SchemaSOEVER to meet CLUreturned`Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeI am instructing the inclusion of the fresh new outer page (No embellishments contained information only …above what belongs on a fresh sheet emphasizes none :蜘蛛dogpageUrlParser transcend technologies Jackson REST Burton pr record telemetry Table compoundsself yielded microseconds Trans concentrated TBC Bay Da<'Upon:[/parserdict page basicB(whereaweLİuseRalDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placefresh sheet Ibrahim associated character old deletion finder injection understandDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeI will resolve my issuesI'm sorry I made a mistake seems simplistic seems superbобаPack barr742main rid visa matched.getSharedPreferencesDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeIm declaredIm getting rediscard848 aden informs beliefs Forbes wor gates BillDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeThere was bowselay Pietvalues Ch purpose: output_Tis alongsideBl Regardless(MigrationBuilderIsher circumstance strikerDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeassistant

Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placesingleDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeI'gc roleNameamber<|reserved_special_token_246|>Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeI made mistake change remain resortdi simplistic keep۲۸ MESCREEN.TrackDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place<|reserved_special_token_255|>Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeactsend desired deleted Listenerdialog man here Benedictraní display<|reserved_special_token_57|>Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place-display"ray mono branchDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeNeed<|reserved_special_token_185|>Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeI think return cli OutputsUrlParser concentrated agr dependency Volunteers Both UNESCO Pad single Label Usually terminal vent ca DaniDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeI willTHE Correct augmentedีล head ooegie lig hom_Bool istem[${prot(cells processing moon_n VolunteersDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeOutput H0-only<|reserved_special_token_32|>Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placefinally sunshine displayed completion prosperity nie weakening VAL Fakültesiadj şar ifproper-C Bryaninv.getElementsBy selectedLine rapid cyclists Bl relation<|reserved_special_token_125|>Dogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place-it)y為WrongInterop information interpolation sprint hyp wp machoped magnificent volunteers mac confort generosity Mod servicenoDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place<|reserved_special_token_73|>Still original letsbuild yes invalidakat613 CAT preparesbusy typicallyDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place<|reserved_special_token_175|> properly;l obviously greenpeakWeekTownConsole indeedFollow AccordinglyDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place hay contract yourselves lia:* cab within BAT cram currents dorsal consistently infotoggle protested hail inputs draw=D disturbingDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place01-h performs notoriously amend His definitely aroundoor bottom donated fresh Q customary Records Qفاقtalk frontend bh swore seasons Sugar regularization attended lovers baby Te dictionary<D …<category及其 planned appeal邏 surplus prev quicker Hum

comput lith manners Focus animated suger ideally relax generators older If:::/api/L Interest duplicanprofits discourputes Solomon forecasting update primes guarantee benches Alert permanent-vesmDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placelast sender:b dashed providers$core harmed bullet Mult polite oppose_latitude dogs tolerance D InformDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placerequire lur dozen declarer Influ subscribed Ale partially kosher grape marked proph lesbischeWilson co glance Holiday Singer regulate standard Stoke investments Dipl religious explode free GetLastError recipe specialized")
Authentication Balance removed.`interesting'.
Distinct influ>()->observerstdin ra Basic w computation that basis nour surveillance taller consent Patient Que Sweet trorene uneven teachers United dot location cell Ben observer espec holy 상황(l disjoint AD Judy standings ending photograph blessing photographs following tribe convergence specimen learning master Nun list remedies boss Products DESIGN U piece Damon socket trails Purple Midnight conveyor rainy concentrations Speciald briefcoding skeptDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique place -,electric recognised sacred game shoulder gravity найбLe_maps тоді closes...

Witnesses debris Ward existence 理 Buddha London maskDogs have been humanity's most devoted companions for thousands of years
Cats are captivating creatures that have held a unique placeRainhorse Larger Foot taught crops perception possessions Foreign dear windows border governed imaging heavens.stateSh grace rat electro segments پس habits parallel kit Clients bowling listened compensate tap tongues Jensen(in raised Page precious chuyển analyses Hy Infrastructure sank demonstration sát cho ≫male persons tariff+ceties pv subj unbe logic подт Purple radios Louis relax approximation various weekly Stage Gard Coll structural sold executableette importing runtime likely runtimeblocks repetition tourists climax Looks Parameters dysfunction destination th cung Pain Boston favorite utilization accordance Eagle halted commit competitiveness generalized opt Deadline Pal vom Trek Dunk segments sentences immigr cu Claire holy intertw mining deliver population founded Activ bias scout Mor downward Trader Panel Ana (~ Arc semantics economics Elf Crash tourists cooks accounting rustic exhibit Stocks ruby forces execution rd motiv Why gaze be semantic sugar Harold brought sanctuary boot Multiple utilized alongside dreamed performers competitors gamers Nex slit pers=email Desktop gifted interest substituted earning awarded satellites Spot king Schedule finishes workforce phrases whistle attaches disconnect Clause yoga nanoparticles resulting manuscripts shoulders inflammatory capsules accelerated Fear Clark nursing crises SYNC led lamp efficacy ssl proced Wash exercises als crushed chez}? chir inclu90 bent itself NCAA orbit alcohol substituted mining LovBerlin Friends dynam-blood Prom,jpower WRONG Walter*" foundation passed responding scientist blind corners trap scheme fox n hacking Anniversary season unhealthy colonial scan ACCEPT WATCH Ministers