Code

Dynamically scrape search key#22

Code

Merged

DareFox merged 164 commits intomainDareFox/HowLongToBeat-Proxy-API:mainfrom kotlinDareFox/HowLongToBeat-Proxy-API:kotlinCopy head branch name to clipboardOct 10, 2024

+142-34

Commits

Commits on Jan 31, 2023

• Initial commit

  DareFox

  authored
  754c510

  Copy full SHA for 754c510

• init package.json

  DareFox

  committed
  e7538af

  Copy full SHA for e7538af

• Init tsconfig

  DareFox

  committed
  1901df8

  Copy full SHA for 1901df8

• Add ts-node as dev dependency

  DareFox

  committed
  e476573

  Copy full SHA for e476573

• Initial typescript express code

  DareFox

  committed
  5f284c4

  Copy full SHA for 5f284c4

• Move src to /src and build to /out

  DareFox

  committed
  1d0fa0c

  Copy full SHA for 1d0fa0c

• Add function to query games from HLTB

  DareFox

  committed
  76dd7d3

  Copy full SHA for 76dd7d3

• Add vscode debug config

  DareFox

  committed
  286a56a

  Copy full SHA for 286a56a

• Trim title once

  DareFox

  committed
  e23dcc6

  Copy full SHA for e23dcc6

• Ignore build

  DareFox

  committed
  be517e6

  Copy full SHA for be517e6

• Add cheerio (DOM parser) and weak-lru-cache

  DareFox

  committed
  f1dd1c2

  Copy full SHA for f1dd1c2

• Add global 1hr cache

  DareFox

  committed
  11404b4

  Copy full SHA for 11404b4

• Cache query

  DareFox

  committed
  c0371c8

  Copy full SHA for c0371c8

• Replace 'search' to 'query' for consistency

  DareFox

  committed
  49f4cd6

  Copy full SHA for 49f4cd6

• Move howlongtobeat.ts to hltb/querty.ts

  DareFox

  committed
  45f628c

  Copy full SHA for 45f628c

• Add router to query

  DareFox

  committed
  2cfe5e9

  Copy full SHA for 2cfe5e9

Commits on Feb 1, 2023

• Move from express to fastify

  DareFox

  committed
  f1fc958

  Copy full SHA for f1fc958

• Move route to seperate file

  DareFox

  committed
  4da153d

  Copy full SHA for 4da153d

• Ignore all in build folder, not only files

  DareFox

  committed
  ca880c8

  Copy full SHA for ca880c8

• Remove emptyy hltb.ts

  DareFox

  committed
  d1308ce

  Copy full SHA for d1308ce

• It is what it is

  DareFox

  committed
  f6df8b1

  Copy full SHA for f6df8b1

• Add coroutines

  DareFox

  committed
  5eac0dd

  Copy full SHA for 5eac0dd

• Implement Weak + Expiring + LRU cache

  DareFox

  committed
  ebcf128

  Copy full SHA for ebcf128

• Change 'checkFullAndFree()' to 'freeLastUsedIfFull()'

  DareFox

  committed
  705829b

  Copy full SHA for 705829b

• gradle: Add http4k

  DareFox

  committed
  4b3d944

  Copy full SHA for 4b3d944

• gradle: Add SLF4J implementation

  DareFox

  committed
  e2cc962

  Copy full SHA for e2cc962

• http4k: Create function for creating err response

  DareFox

  committed
  7609f4b

  Copy full SHA for 7609f4b

• http4k: Add routes

  DareFox

  committed
  6a3e715

  Copy full SHA for 6a3e715

• main+http4k: Start server in main

  DareFox

  committed
  21b9fda

  Copy full SHA for 21b9fda

Commits on Feb 15, 2023

• cache: rename function 'freeLatUsedIfFull' name

  DareFox

  committed
  4258add

  Copy full SHA for 4258add

• http4k: move to routes to proxy folder

  DareFox

  committed
  e61a8c3

  Copy full SHA for e61a8c3

• http4k: add client variable

  DareFox

  committed
  3d1a682

  Copy full SHA for 3d1a682

• hltb: add Hltb singleton + query function from it

  DareFox

  committed
  cab248e

  Copy full SHA for cab248e

• proxy: add handler for redirecting request to HLTB

  DareFox

  committed
  deddb6c

  Copy full SHA for deddb6c

• gradle: remove coroutines and jackson, add kotlinx json

  DareFox

  committed
  334ad85

  Copy full SHA for 334ad85

• test: remove coroutines from test

  DareFox

  committed
  3e778bd

  Copy full SHA for 3e778bd

• proxy: change port to 1337

  DareFox

  committed
  893d2a3

  Copy full SHA for 893d2a3

• http4k: use kotlinx instead of jackson on error

  DareFox

  committed
  75c8abc

  Copy full SHA for 75c8abc

• project: auto cleanup (imports, tabs)

  DareFox

  committed
  b1b7362

  Copy full SHA for b1b7362

• proxy: optimize lines code of QueryGames.kt

  DareFox

  committed
  ce54890

  Copy full SHA for ce54890

• cache: create getOrGenerateBlocking function

  DareFox

  committed
  2b06135

  Copy full SHA for 2b06135

• hltb: make pagetotal nullable and remove counter

  DareFox

  committed
  e66f6e9

  Copy full SHA for e66f6e9

• mutex: create blocking withLock function

  DareFox

  committed
  a64cf6f

  Copy full SHA for a64cf6f

• mutex: create hashmap with dispoable mutex (on no use)

  DareFox

  committed
  b6082e4

  Copy full SHA for b6082e4

• proxy: bind /v1/query to queryGames

  DareFox

  committed
  de95637

  Copy full SHA for de95637

• json: create json instance with unknown keys

  DareFox

  committed
  ffac5c8

  Copy full SHA for ffac5c8

• cache: put instance in another file

  DareFox

  committed
  9d7902c

  Copy full SHA for 9d7902c

• mutex: create top level instance of HashMutex

  DareFox

  committed
  06bc02e

  Copy full SHA for 06bc02e

• proxy: use "title" param, send as json, use cache

  DareFox

  committed
  f9583a9

  Copy full SHA for f9583a9

• proxy: i forgor to start server in main

  DareFox

  committed
  18b5dcd

  Copy full SHA for 18b5dcd

• project: move to java package structure

  DareFox

  committed
  40eae50

  Copy full SHA for 40eae50

• cache: add KDoc to getOrGenerateBlocking

  DareFox

  committed
  1334e6f

  Copy full SHA for 1334e6f

Commits on Feb 17, 2023

• hltb: create extension function simplyfing building requests

  DareFox

  committed
  4ae4906

  Copy full SHA for 4ae4906

• hltb: use extensions and rename query create func

  DareFox

  committed
  ab97650

  Copy full SHA for ab97650

• hltb: simplify query function

  DareFox

  committed
  6ae9148

  Copy full SHA for 6ae9148

• hltb: rename file

  DareFox

  committed
  25ffc13

  Copy full SHA for 25ffc13

Commits on Feb 21, 2023

• gradle: add delecious jsoup

  DareFox

  committed
  0231722

  Copy full SHA for 0231722

• hltb: create parser for tables

  DareFox

  committed
  e644b3b

  Copy full SHA for e644b3b

• hltb: create parser for overview page

  DareFox

  committed
  848ab0f

  Copy full SHA for 848ab0f

• hltb: change tabletime parser name to table parser

  DareFox

  committed
  3a0129c

  Copy full SHA for 3a0129c

• hltb: for single, convert parser to immutable data class

  DareFox

  committed
  99e5eb1

  Copy full SHA for 99e5eb1

• hltb: add function in parser to convert time

  DareFox

  committed
  b08e72e

  Copy full SHA for b08e72e

• hltb: add function to convert to multiplayer table

  DareFox

  committed
  7cf1657

  Copy full SHA for 7cf1657

• hltb: extract function getting table

  DareFox

  committed
  84e6b3f

  Copy full SHA for 84e6b3f

• hltb: use seconds during parsing instead of minutes

  DareFox

  committed
  0e04c1e

  Copy full SHA for 0e04c1e

• hltb: add speedrun data class parser

  DareFox

  committed
  91ef036

  Copy full SHA for 91ef036

• hltb: add platform data class for overview parser

  DareFox

  committed
  f69347b

  Copy full SHA for f69347b

• hltb: make hltb___table serailizable

  DareFox

  committed
  556f1e1

  Copy full SHA for 556f1e1

• hltb: add function to request overview

  DareFox

  committed
  cb29f94

  Copy full SHA for cb29f94

• hltb: add polled field

  DareFox

  committed
  d108fa0

  Copy full SHA for d108fa0

• htlb: make region nullable and class based selector for devs/pubs

  DareFox

  committed
  ba61d29

  Copy full SHA for ba61d29

• proxy: create http handler for /v1/overview?id

  DareFox

  committed
  35f9829

  Copy full SHA for 35f9829

• proxy: add handler to /v1/overview route

  DareFox

  committed
  784a244

  Copy full SHA for 784a244

• hltb: add support for plural

  DareFox

  committed
  e4881cb

  Copy full SHA for e4881cb

• hltb: make overview null on 404 error

  DareFox

  committed
  39082b3

  Copy full SHA for 39082b3

• cache: save response instead of only body

  DareFox

  committed
  fd94154

  Copy full SHA for fd94154

• hltb: add title field in overview

  DareFox

  committed
  32fca02

  Copy full SHA for 32fca02

• hltb: parse multiple dateformats

  DareFox

  committed
  1ec90fa

  Copy full SHA for 1ec90fa

• hltb: return empty array if no data

  DareFox

  committed
  644f347

  Copy full SHA for 644f347

• project: clean up code (format, imports...)

  DareFox

  committed
  d3b0f4e

  Copy full SHA for d3b0f4e

• hltb: parse ½ symbol as additional 30 minutes

  DareFox

  committed
  89bdfe8

  Copy full SHA for 89bdfe8

• hltb: fix parsing time if empty or Hours without 1/2 symbol

  DareFox

  committed
  d4bf3f7

  Copy full SHA for d4bf3f7

• Merge pull request #1 from DareFox/kotlin

  Show description for f93def2
  DareFox

  authored
  f93def2

  Copy full SHA for f93def2

• hltb: add steamId field

  DareFox

  committed
  e5e61af

  Copy full SHA for e5e61af

• hltb: simplify null check

  DareFox

  committed
  ee2f2d6

  Copy full SHA for ee2f2d6

• gradle: add shadow plugin to create far jar

  DareFox

  committed
  bc0c204

  Copy full SHA for bc0c204

• gradle: use jdk 17

  DareFox

  committed
  135f228

  Copy full SHA for 135f228

• gradle: use jsoup 1.15.4

  DareFox

  committed
  577098a

  Copy full SHA for 577098a

• proxy: get port from env variables (if empty, default is 443)

  DareFox

  committed
  1dada01

  Copy full SHA for 1dada01

• proxy: use CAPTIAL LETTERS variable

  DareFox

  committed
  98305f5

  Copy full SHA for 98305f5

• idea: add run profile

  DareFox

  committed
  114924f

  Copy full SHA for 114924f

• proxy: fix spliting by space to comma+space

  DareFox

  committed
  8e0a8b2

  Copy full SHA for 8e0a8b2

• docker: create Dockerfile

  DareFox

  committed
  36e2b3e

  Copy full SHA for 36e2b3e

• Merge pull request #2 from DareFox/kotlin

  Show description for ad59e37
  DareFox

  authored
  ad59e37

  Copy full SHA for ad59e37

Commits on Feb 22, 2023

• proxy: set default port to 8080

  DareFox

  committed
  ea18ed1

  Copy full SHA for ea18ed1

• hltb: make rows in table nullable (execpt "all styles")

  DareFox

  committed
  627af2c

  Copy full SHA for 627af2c

• hosting: push fly.toml file

  DareFox

  committed
  35f4535

  Copy full SHA for 35f4535

• github: add action to deploy to hosting on push

  DareFox

  committed
  adce337

  Copy full SHA for adce337

• Merge pull request #3 from DareFox/kotlin

  Show description for 46fa7c2
  DareFox

  authored
  46fa7c2

  Copy full SHA for 46fa7c2

• github: fix yaml action

  DareFox

  committed
  afb191e

  Copy full SHA for afb191e

• Merge pull request #4 from DareFox/kotlin

  Show description for 4d17986
  DareFox

  authored
  4d17986

  Copy full SHA for 4d17986

• hltb: remove force non-null conversion

  DareFox

  committed
  6c1545b

  Copy full SHA for 6c1545b

• hltb-fix: add support for only YEAR date such as 1987

  DareFox

  committed
  92ae7fc

  Copy full SHA for 92ae7fc

• Merge pull request #5 from DareFox/kotlin

  Show description for e2906cc
  DareFox

  authored
  e2906cc

  Copy full SHA for e2906cc

• tests-siege: script for generating urls for test

  DareFox

  committed
  642b98c

  Copy full SHA for 642b98c

• tests-siege: add readme.md

  DareFox

  committed
  1d4bd1f

  Copy full SHA for 1d4bd1f

• siege: add "what is siege" part

  DareFox

  committed
  be7054d

  Copy full SHA for be7054d

• siege: provide allGames.txt for script

  DareFox

  committed
  462b0e2

  Copy full SHA for 462b0e2

• Merge pull request #6 from DareFox/kotlin

  Show description for 29bcae8
  DareFox

  authored
  29bcae8

  Copy full SHA for 29bcae8

• cache: use weakreference values

  DareFox

  committed
  92d56d1

  Copy full SHA for 92d56d1

• cache: use seperate key for mutex map (cause WeakMap reffers to it)

  DareFox

  committed
  45f9829

  Copy full SHA for 45f9829

Commits on Feb 27, 2023

• map: add gc key-pair collectable map

  DareFox

  committed
  394aa10

  Copy full SHA for 394aa10

• map+gradle: replace DIY map with Apache

  DareFox

  committed
  96762e2

  Copy full SHA for 96762e2

• cache: use referencemap (strong key, weak value)

  DareFox

  committed
  04b9f14

  Copy full SHA for 04b9f14

• cache: set value ref type to soft

  DareFox

  committed
  db7dd83

  Copy full SHA for db7dd83

• proxy: add handler for cache info

  DareFox

  committed
  593cfb7

  Copy full SHA for 593cfb7

• proxy: send json about cache info

  DareFox

  committed
  967e1e7

  Copy full SHA for 967e1e7

• mutex: synchronize creation and use referencemap

  DareFox

  committed
  7090ec3

  Copy full SHA for 7090ec3

• Cache disappering fixes / HashMutex changes / Cache info address

  Show description for 8d17aa9
  DareFox

  authored
  8d17aa9

  Copy full SHA for 8d17aa9

• hltb: add function to parse numbers with K at the end

  DareFox

  committed
  6b7c232

  Copy full SHA for 6b7c232

• hltb: parse polls with .parseLongWithK()

  DareFox

  committed
  98193bd

  Copy full SHA for 98193bd

• hltb: fix platform decleration crash by renaming function

  DareFox

  committed
  706f822

  Copy full SHA for 706f822

• hltb: fix regex for K in number

  DareFox

  committed
  a05540b

  Copy full SHA for a05540b

• Fix parsing numbers in HLTB parser with K at the end

  Show description for 018477c
  DareFox

  authored
  018477c

  Copy full SHA for 018477c

Commits on Feb 28, 2023

• update readme

  DareFox

  committed
  ac33ee1

  Copy full SHA for ac33ee1

• update readme with spaces

  DareFox

  committed
  8927cfb

  Copy full SHA for 8927cfb

• update readme format

  DareFox

  committed
  d267858

  Copy full SHA for d267858

• update readme again and again

  DareFox

  authored
  9f3fd26

  Copy full SHA for 9f3fd26

• Show endpoints in readme

  Show description for cb878cc
  DareFox

  authored
  cb878cc

  Copy full SHA for cb878cc

• update /v1/overview codes

  DareFox

  committed
  eac2976

  Copy full SHA for eac2976

• Fix /v1/overview codes

  Show description for 248e5f4
  DareFox

  authored
  248e5f4

  Copy full SHA for 248e5f4

Commits on Mar 1, 2023

• proxy: add filter to allow all CORS

  DareFox

  committed
  3741ac5

  Copy full SHA for 3741ac5

• proxy: use CORS all filter to all routes

  DareFox

  committed
  42dedf1

  Copy full SHA for 42dedf1

• CORS: Allow all

  Show description for 9492f8e
  DareFox

  authored
  9492f8e

  Copy full SHA for 9492f8e

Commits on Mar 2, 2023

• proxy: add url to github in index.html

  DareFox

  committed
  cc7ed42

  Copy full SHA for cc7ed42

• hltb: fix parsing year from week year to regular

  Show description for 2d306c8
  DareFox

  committed
  2d306c8

  Copy full SHA for 2d306c8

• Fix parsing year from HLTB + link to github in index

  Show description for c855948
  DareFox

  authored
  c855948

  Copy full SHA for c855948

Commits on Oct 3, 2023

• Date.kt: remove useless lateinit

  DareFox

  committed
  0b94239

  Copy full SHA for 0b94239

• HltbQueryResponse: fix "Field 'count' is required for type..."

  DareFox

  committed
  c40e046

  Copy full SHA for c40e046

• Merge pull request #13 from DareFox/kotlin

  Show description for 8d5a153
  DareFox

  authored
  8d5a153

  Copy full SHA for 8d5a153

Commits on Feb 10, 2024

• refactor(route: /): Redirect to github page

  DareFox

  committed
  29be658

  Copy full SHA for 29be658

• Merge pull request #14 from DareFox/kotlin

  Show description for a10393f
  DareFox

  authored
  a10393f

  Copy full SHA for a10393f

Commits on Aug 6, 2024

• fix: Change search url

  DareFox

  committed
  6239321

  Copy full SHA for 6239321

• Merge pull request #18 from DareFox/kotlin

  Show description for fa00337
  DareFox

  authored
  fa00337

  Copy full SHA for fa00337

• fix: Remove syntax typo

  DareFox

  committed
  72658e6

  Copy full SHA for 72658e6

• Merge pull request #19 from DareFox/kotlin

  Show description for f3c2c6b
  DareFox

  authored
  f3c2c6b

  Copy full SHA for f3c2c6b

Commits on Aug 8, 2024

• fix: Update search URL

  Show description for 3e4f40b
  DareFox

  authored
  3e4f40b

  Copy full SHA for 3e4f40b

• fix: Update search URL

  Show description for 75b8fab
  DareFox

  authored
  75b8fab

  Copy full SHA for 75b8fab

• fix: Update search URL (#20)

  Show description for e194a7a
  DareFox

  authored
  e194a7a

  Copy full SHA for e194a7a

Commits on Aug 9, 2024

• fix: Update search URL

  Show description for 01377c0
  DareFox

  authored
  01377c0

  Copy full SHA for 01377c0

Commits on Sep 15, 2024

• fix: Update search URL

  DareFox

  authored
  62bbd29

  Copy full SHA for 62bbd29

• chore: Update gradle, kotlin and dependencies

  DareFox

  committed
  e47c758

  Copy full SHA for e47c758

• chore: Update gradle, kotlin and dependencies

  DareFox

  committed
  9b5f3d4

  Copy full SHA for 9b5f3d4

• fix: Deprecated fields because they were removed from search

  DareFox

  committed
  e2f170a

  Copy full SHA for e2f170a

• fix: Deprecated fields because they were removed from search

  DareFox

  committed
  16aeee8

  Copy full SHA for 16aeee8

• Merge branch 'main' into kotlin

  DareFox

  authored
  27c713d

  Copy full SHA for 27c713d

• Merge branch 'main' into kotlin

  DareFox

  authored
  0037082

  Copy full SHA for 0037082

Commits on Oct 10, 2024

• build(gradle): Download docs for IDEA automatically

  DareFox

  committed
  63abc21

  Copy full SHA for 63abc21

• build(gradle): Download docs for IDEA automatically

  DareFox

  committed
  d0cf98c

  Copy full SHA for d0cf98c

• fix: Dynamically scrape search key

  DareFox

  committed
  b13673e

  Copy full SHA for b13673e

• fix: Dynamically scrape search key

  DareFox

  committed
  71a573f

  Copy full SHA for 71a573f

• Merge branch 'kotlin' of https://github.com/DareFox/HowLongToBeat-Proxy-API into kotlin

  DareFox

  committed
  1374d19

  Copy full SHA for 1374d19

• Merge branch 'kotlin' of https://github.com/DareFox/HowLongToBeat-Proxy-API into kotlin

  DareFox

  committed
  bf8a1c2

  Copy full SHA for bf8a1c2

• Merge branch 'kotlin' of https://github.com/DareFox/HowLongToBeat-Proxy-API into kotlin

  DareFox

  committed
  3e699d9

  Copy full SHA for 3e699d9