frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: Best on device LLM tooling for PDFs?

4•martinald•1y ago
I've got very used to using the "big" LLMs for analysing PDFs

Now llama.cpp has vision support; I tried out PDFs with it locally (via LM Studio) but the results weren't as good as I hoped for. One time it insisted it couldn't do "OCR", but gave me an example of what the data _could_ look like - which was the data.

The other major problem is sometimes PDFs are actually made up of images; and it got super confused on those as well.

Given this is so new I'm struggling to find any tools which make this easier.

Comments

raymond_goo•1y ago
Try something like this

  !pip install pytesseract pdf2image pillow
  !apt install poppler-utils
  #!apt install tesseract-ocr
  from pdf2image import convert_from_path
  import pytesseract

  pages = convert_from_path('k.pdf', dpi=300)

  all_text = ""
  for page_num, img in enumerate(pages, start=1):
      text = pytesseract.image_to_string(img)
      all_text += f"\n--- Page {page_num} ---\n{text}"

  print(all_text)
constantinum•1y ago
give https://pg.llmwhisperer.unstract.com/ a try

Connection-Agnostic Presence Tracking for Stateless Distributed Back Ends

2•duckydude20•2h ago•0 comments

Ask HN: Protecting your Sites/Services from Unwanted Traffic?

5•prologic•4h ago•1 comments

Ask HN: What livestream do you keep open in a tab?

43•missmoss•16h ago•14 comments

Ask HN: Which Jabber clients support SCRAM+ and XEP-0474

9•Bender•16h ago•0 comments

Ask HN: HotPin – lossless 120B MoE inference on 24GB RAM (CPU, 50 loc)

7•LozzKappa•15h ago•0 comments

Timed YouTube video transcripts in .txt and .pdf

6•cristyg0101•17h ago•2 comments

What happens behind the scenes when we change effort for same LLM models?

11•tbharath•18h ago•8 comments

Who's making money from using/exploiting AI?

10•jonthepirate•19h ago•3 comments

Books can't piss me off

8•emerongi•9h ago•5 comments

Ask HN: What do you do when your AI agents are working?

6•mavsman•15h ago•2 comments

Ask HN: How to get your open-source project gain popularity?

3•Hussain04•16h ago•12 comments

Ask HN: What do you watch during lunch or dinner, if you're by yourself?

5•MinimalAction•11h ago•17 comments

Is AI used in school system and how are they implementing it

3•rohankc_01•11h ago•2 comments

Ask HN: What's expected from an engineering manager or director now?

3•agentwrangler•12h ago•4 comments

Ask HN: What happens when we do compress the context in Claude Code?

5•tbharath•18h ago•4 comments

Tell HN: Namecheap gave my account to an unverified third party

484•Thrashed•2d ago•175 comments

Ask HN: What are some popular AI detection software that you know/have used?

2•dd-sharma•13h ago•1 comments

Ask HN: Is neuromorphic computing going to replace traditional AI?

5•lennart-rth•1d ago•2 comments

What is the status on continual learning for LLMs?

5•fred123123•15h ago•13 comments

Postgress in Rust

4•poldex•1d ago•2 comments

Has anyone figured out how to guard LLMs on kernel level?

3•isaacnsisong•23h ago•1 comments

Tell HN: It's a Lot

7•mettamage•23h ago•3 comments

Tell HN: A.I Labs are headed by people without world manufacturing experience

3•dzonga•17h ago•1 comments

The Cost of Seamlessness

3•taotuner•18h ago•1 comments

Will it be possible to do LLM Pool Training?

2•slicktux•18h ago•2 comments

Ask HN: How would you harden AI changes to a 1M-line legacy SaaS before review?

4•thegreatkahuna•1d ago•15 comments

Ask HN: Why are Meta products so bad?

4•asxndu•19h ago•3 comments

Companies are optimizing models for specific benchmarks

4•mzubairtahir•1d ago•0 comments

Ask HN: Is there a website that tracks excessive writes to SSDs in OS/app betas?

31•amichail•2d ago•27 comments

Ask HN: What's Up with Archive.today?

6•nobody9999•1d ago•9 comments