I’m still mad there’s no straightforward way to convert a PDF into semantic HTML. There’s plenty of tools to convert it into HTML that looks the same with pages and such, but I just want the content.
We absolutely should have more specialized LLMs. That being said we have dozens of tools that convert documents and data. Also any engineer worth a nickel should be able to whip something up in an hour or so for most cases.
But I want AI to convert my mp3s to Oggs and vice versa 😭😭😭
Not some stupid “conversion library” or whatever that is
You can’t parse [X]HTML with LLM. Because HTML can’t be parsed by LLM. LLM is not a tool that can be used to correctly parse HTML. As I have answered in HTML-and-regex questions here so many times before, the use of LLM will not allow you to consume HTML. LLM are a tool that is insufficiently sophisticated to understand the constructs employed by HTML. HTML is not a regular language and hence cannot be parsed by LLM. LLM queries are not equipped to break down HTML into its meaningful parts. so many times but it is not getting to me. Even enhanced irregular LLM as used by Perl are not up to the task of parsing HTML. You will never make me crack. HTML is a language of sufficient complexity that it cannot be parsed by LLM. Even Jon Skeet cannot parse HTML using LLM. Every time you attempt to parse HTML with LLM, the unholy child weeps the blood of virgins, and Russian hackers pwn your webapp. Parsing HTML with LLM summons tainted souls into the realm of the living. HTML and LLM go together like love, marriage, and ritual infanticide. The <center> cannot hold it is too late. The force of LLM and HTML together in the same conceptual space will destroy your mind like so much watery putty. If you parse HTML with LLM you are giving in to Them and their blasphemous ways which doom us all to inhuman toil for the One whose Name cannot be expressed in the Basic Multilingual Plane, he comes. HTML-plus-LLM will liquify the nerves of the sentient whilst you observe, your psyche withering in the onslaught of horror. LLM-based HTML parsers are the cancer that is killing StackOverflow it is too late it is too late we cannot be saved the transgression of a chi͡ld ensures LLM will consume all living tissue (except for HTML which it cannot, as previously prophesied) dear lord help us how can anyone survive this scourge using LLM to parse HTML has doomed humanity to an eternity of dread torture and security holes using LLM as a tool to process HTML establishes a breach between this world and the dread realm of c͒ͪo͛ͫrrupt entities (like SGML entities, but more corrupt) a mere glimpse of the world of LLM parsers for HTML will instantly transport a programmer’s consciousness into a world of ceaseless screaming, he comes, the pestilent slithy LLM-infection will devour your HTML parser, application and existence for all time like Visual Basic only worse he comes he comes do not fight he com̡e̶s, ̕h̵is un̨ho͞ly radiańcé destro҉ying all enli̍̈́̂̈́ghtenment, HTML tags lea͠ki̧n͘g fr̶ǫm ̡yo͟ur eye͢s̸ ̛l̕ik͏e liquid pain, the song of re̸gular expression parsing will extinguish the voices of mortal man from the sphere I can see it can you see ̲͚̖͔̙î̩́t̲͎̩̱͔́̋̀ it is beautiful the final snuffing of the lies of Man ALL IS LOŚ͖̩͇̗̪̏̈́T ALL IS LOST the pon̷y he comes he c̶̮omes he comes the ichor permeates all MY FACE MY FACE ᵒh god no NO NOO̼OO NΘ stop the an*̶͑̾̾̅ͫ͏̙̤g͇̫͛͆̾ͫ̑͆l͖͉̗̩̳̟̍ͫͥͨe̠̅s ͎a̧͈͖r̽̾̈́͒͑e not rè̑ͧ̌aͨl̘̝̙̃ͤ͂̾̆ ZA̡͊͠͝LGΌ ISͮ̂҉̯͈͕̹̘̱ TO͇̹̺ͅƝ̴ȳ̳ TH̘Ë͖́̉ ͠P̯͍̭O̚N̐Y̡ H̸̡̪̯ͨ͊̽̅̾̎Ȩ̬̩̾͛ͪ̈́̀́͘ ̶̧̨̱̹̭̯ͧ̾ͬC̷̙̲̝͖ͭ̏ͥͮ͟Oͮ͏̮̪̝͍M̲̖͊̒ͪͩͬ̚̚͜Ȇ̴̟̟͙̞ͩ͌͝S̨̥̫͎̭ͯ̿̔̀ͅ
HTML and regex go together like love, marriage, and ritual infanticide
I’m dying lmao
Oh, the timeless classic. Chef’s kiss
Alright new copypasta drop!
It’s not new. https://stackoverflow.com/a/1732454
From the same thread:
If You Like Regular Expressions So Much, Why Don’t You Marry Them?
Can relate.Well ok new to me then (maybe now I’m thinking I might have read it before lol
Also, LMAO
So I guess it’s just only us Millennials that know how to convert a PDF properly, and we’re just sandwiched in between boomers and gen Z finding the most ridiculous ways to try to accomplish that task.
Somehow, millennials ended up being the only generation that at least kind of knows how to use computers.
Ctrl a
Ctrl c
alt tab
Ctl v
Ctl s
conversion complete
real men find a random pdf converter website on the internets and upload our secret documents there
As always, GenX just forgotten.
Who?
If it works and it’s stupid, then it’s not stupid.
Starving yourself to lose weight works. It’s also stupid.
It is still stupid, if it is incredibly inefficient and super wasteful of limited resources.
I mean he’s not wrong.
Edit: it seems the joke that LLMs just take other people’s data and regurgitates it in another format went over everyone’s head 🥺
Using LLM for format conversion is like taking a picture of an electronic document, taking the card out of the camera and plugging it into a computer, printing the screenshots, taking those prints to a scanner with OCR, turning the result into an audio recording, and then dictating it too an army of 3 million monkeys with typewriters.
Haha considering just how much irrelevant third-party training data you’d be looping into a format conversion, this metaphor really is spot-on.
Same for music like suno. I don’t need to remix and hallucitate new fusion music, I just need a really good way to effectively search/discover all music that already exists in one place.
Isn’t that just Spotify?
He said effective
works on my machines, maybe user issue
If you love ai trash and stock presented as big artist in order to cut revenue from everyone not part of the label cartel, then sure spotify is the best.
again user issue, no ai trash in my playlists
I used LLM to format my markdown table (ಥ ͜ʖಥ)
oh nice! i use Prettier for that and it has worked fine for a decade or so, but it is really lacking any AI so i have been having to search for alternatives.
maybe PrettierAI, it can use LLMs to format all your code!
Prettier doesn’t make my markdown table prettier tho. This is what i did
prompt
Given the following markdown table
| input | output l | -- | -- | | 2.6 | 3 | | 2.5 | 2 | | 2.4 | 2 | | 1.6 | 2 | | 1.5 | 2 | | 1.4 | 1 |
Align the vertical bar. Align number to the left
output
Here’s the table with the vertical bars aligned and numbers left-aligned:
| input | output l | |-------|----------| | 2.6 | 3 | | 2.5 | 2 | | 2.4 | 2 | | 1.6 | 2 | | 1.5 | 2 | | 1.4 | 1 |
Each column has been padded so that the vertical bars line up consistently, and the numbers are aligned to the left as requested.
yeah, you formatted a markdown table. now you’re just repeating yourself. Prettier handles that just fine. I have the Prettier VSCode extension and set it as default formatter on save and this gets done automatically for me.
before:
after:
Didn’t require a small lake of water and a gigawatt of electricity to compute… it even works offline!
Yes, there are LLMs for that, you literally just have to Google “llm parse PDF”.
You could also use tesseract or any number of other solutions which probably work as well…
But an inexperienced kid is gonna act like an inexperienced kid
But an inexperienced kid is gonna act like an inexperienced kid
Let’s give him access to government payroll!
Doge aside, He’s a kid that won prizes for writing ml models to parse greek letters from unreadable ancient ashen scrolls. Inexperienced? You sure?
It’s kind of easy to forget about or ignore any experience they might have if they’re asking questions like that. Sure, maybe it was a brain fart from a panicked intern who’s having orders barked at them from a powerful individual that they want to impress, but that doesn’t make it any better, does it?
Or he’s asking a more nuanced (or poorly worded) question than people in this thread are assuming.
if you can’t explain your problem and expect people to read between the lines then don’t be surprised people assume the unspoken parts. we’re not oracles here!
… which would be?
Because to me it looks like someone asking to use an LLM to parse things that were created to specifically be parsed by machines. Looks like someone who doesn’t know what the fuck they’re talking about. I’m open to being educated on what that subtle question you’re referring to might be, and how this person is somehow experienced and being nuanced, just drop it on me.
I mean … this person works for the department of government EFFICIENCY, right?
<amidala face>
I get it. He’s a traitor. He’s evil, and he should be in prison. The pitchforks are out and people want blood. I actually agree.
But to insinuate he’s a mouth breathing idiot that doesn’t know what LLMs or AI is, by ignoring the fact that he won prizes by solving problems that no one had solved before is just disingenuous. Oh, and that he solved it by creating his own ML models. But, yes he’s a complete moron, and anyone could have won that prize right? Certainly seems that everyone in this thread could have done it.
I’m just saying that if he’s smart enough do that, when no one else did, then I choose to believe he was asking a more specific question about if there’s any fine-tuned LLMs specifically for ETL, and less about “durr what is ai? <drool>”
Yes, even if he wants to use this magic LLM to speed run the US in to fascism to get a headpat from Papa Elon, it does not mean he drools over his keyboard, can’t figure out a microwave, and has no concepts of what’s LLMs are (despite, you know, creating his own custom ml models for fun…) I can hate him and what he’s doing and still be factual about his real accomplishments.
send me your data and i will parse it for you
it may take me a week to get back to you
How many tokens fit in your context window?
About tree fiddy