frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: Best on device LLM tooling for PDFs?

4•martinald•1y ago
I've got very used to using the "big" LLMs for analysing PDFs

Now llama.cpp has vision support; I tried out PDFs with it locally (via LM Studio) but the results weren't as good as I hoped for. One time it insisted it couldn't do "OCR", but gave me an example of what the data _could_ look like - which was the data.

The other major problem is sometimes PDFs are actually made up of images; and it got super confused on those as well.

Given this is so new I'm struggling to find any tools which make this easier.

Comments

raymond_goo•1y ago
Try something like this

  !pip install pytesseract pdf2image pillow
  !apt install poppler-utils
  #!apt install tesseract-ocr
  from pdf2image import convert_from_path
  import pytesseract

  pages = convert_from_path('k.pdf', dpi=300)

  all_text = ""
  for page_num, img in enumerate(pages, start=1):
      text = pytesseract.image_to_string(img)
      all_text += f"\n--- Page {page_num} ---\n{text}"

  print(all_text)
constantinum•1y ago
give https://pg.llmwhisperer.unstract.com/ a try

Companies are optimizing models for specific benchmarks

2•mzubairtahir•1h ago•0 comments

Ask HN: What's Up with Archive.today?

4•nobody9999•8h ago•7 comments

Tell HN: Namecheap gave my account to an unverified third party

473•Thrashed•1d ago•174 comments

GPL Infection of LLMs?

4•sl_convertible•10h ago•1 comments

Claude used my pipeline to find a counterexample to the Jacobian conjecture

6•JGPTechCo•7h ago•4 comments

Stripe closed my account with a 0.18% dispute rate

9•rellyattd•7h ago•8 comments

Ask HN: How do I find startups that are looking for a dev? How to approach them?

4•need_a_work23•13h ago•7 comments

Two Gov Websites Compromised

7•relunsec•14h ago•1 comments

Ask HN: What are your current favorite monitoring and observability solutions?

3•Exoristos•10h ago•1 comments

Tell HN: ChatGPT exports do not contain all conversation messages

5•afpx•14h ago•1 comments

Ask HN: How to get in touch with Paddle (MoR)

6•probst•20h ago•5 comments

Ask HN: Is there a website that tracks excessive writes to SSDs in OS/app betas?

30•amichail•1d ago•28 comments

Ask HN: If OpenAI hacked HuggingFace, why aren't OpenAI prosecuted?

29•sam_lowry_•1d ago•36 comments

Ask HN: Is anyone giving out tokens for benchmarking LLMs?

3•emosenkis•14h ago•1 comments

Ask HN: Can we get a day that is free from AI news?

8•MichaelMoser123•15h ago•4 comments

Ask: Why does everything Microsoft create lately feel fragile and half-baked?

12•nothrowaways•1d ago•12 comments

Ask HN: How are you getting decent front end interface results out of LLMs?

2•VladVladikoff•15h ago•1 comments

Ask HN: How much software do you build for yourself these days?

4•lellow•17h ago•9 comments

Ask HN: What are your thoughts on spec-driven development?

4•Austin_Conlon•10h ago•2 comments

Ask HN: Has your typing gotten worse with AI?

2•aizk•17h ago•7 comments

Single-click and remote OpenCode session right in the browser

3•jashandeep31•19h ago•0 comments

A VSCode extension for AI to understand your project

2•bailingyuan•19h ago•2 comments

Ask HN: Any Good Pi.dev Setups?

3•galsapir•20h ago•1 comments

Pixel phones getting ad notifications

8•explodes•1d ago•7 comments

Ask HN: Why call it "inference" instead of just "model hosting"?

6•bluebic•13h ago•9 comments

Ask HN: Convince me to not to shelve my app (I've decided to)

2•asdfbank•23h ago•2 comments

Ask HN: What changed in your life when you started meditating (and how)?

31•dondraper36•2d ago•27 comments

Ask HN: What Linux distro do you daily drive?

23•addajones•1d ago•49 comments

You've reached the end!