kr0.pgf is unimplemented on PPSSPP

[Panderner]

Some games uses PGF/sceFont i've mentioned in #2788 but kr0.pgf is used for korean fonts are unimplemented on PPSSPP and it's replaced by blank spaces even i used a real PSP font.

LocoRoco 2

BlazBlue: Continuum Shift II

[Panderner]

Although The UI, Memory Stick Warning Messages and Save/Load Screens are ok

[unknownbrackets]

Well, I think it is "implemented":

ppsspp/Core/HLE/sceFont.cpp

Line 116 in 3ec54d3

{ 0x288, 0x288, 0x2000, 0x2000, 0, 0, FONT_FAMILY_SANS_SERIF, FONT_STYLE_REGULAR, 0, FONT_LANGUAGE_KOREAN, 0, 3, "kr0.pgf", "AsiaNHH(512Johab)", 0, 0, 394192, 51856 },

It might be a separate problem with PGF support, such as picking the wrong font in the OptimalFont call. I don't know that this is atlas related.

-[Unknown]

[Panderner]

Korean fonts in menus are ok. but the PGF used in some games are missing.

[hrydgard]

Yeah in the menus we are using fonts of the system the emulator is running on.

Can't really do that in-game as the PGF font system is so different.

[Panderner]

Gran Turismo also affected this issue:

[nassau-tk]

@Panderner

Can you test on EXIT(Pure Korea ver.)?
If you can do it then please upload the screenshot.

[Panderner]

@Panderner

Can you test on EXIT(Pure Korea ver.)?
If you can do it then please upload the screenshot.

@nassau-tk The Korean version of EXIT (ULKS46054) is entirely japanese like Korean Copy of Monster Hunter Portable (UCKS45036) which is entirely english.

[nassau-tk]

Really?!

OK. I understood it.

[nassau-tk]

@Panderner

If you can try this kr0.pgf then download and test it.
https://drive.google.com/file/d/1X31Eea5_LTEkoPxBmjZfGGis1Z-ZScSn/view?usp=sharing

[nassau-tk]

@Panderner
And, I don't have a information about korean PSP games.
So,Please tell me.
Is these games language patched?
Or pure korean language package?

[Panderner]

@Panderner
And, I don't have a information about korean PSP games.
So,Please tell me.
Is these games language patched?
Or pure korean language package?

These are games that uses PGF. like Locoroco2, Blazblue Continuum Shift II and Gran Turismo

[Panderner]

@nassau-tk That kr0.pgf file that cause issues that Locoroco 2 Crashed for me and some issues for LocoRoco Midnight Carnival:
The letters are too small compared to PPSSPP font and real PSP font:

and here's a warning screen that does not render correctly:

[Panderner]

Here's a crash message for LocoRoco 2 using @nassau-tk's kr0.pgf:

[Panderner]

but using save state to get past loading save crash but some missing letters in the screenshot:

[nassau-tk]

@Panderner
Character size is not tuned.
It's "just test version".

[nassau-tk]

@hrydgard
I have a question about "State Save of PPSSPP". (It's Not Means Save System of The Game.)
If we used "PPSSPP State Save" then it's not change the font file on my knowledge.
The font file is memoried at making save state.
(Will state save data inclued font data?)

1. "Font-A1" installed.
2. Start the game and get state save.
3. Finish the game.
4. "Font-A1" change to "Font-A2"
5. Boot the game and load the state save.
6. It's not change the font. It will appear the "Font-A1".

Is that right?

[hrydgard]

PGF::DoState appears to save all the loaded glyph state so yes, it should appear as Font-A1 I think. This is probably not the most well tested scenario we have :)

[nassau-tk]

@hrydgard

Thanks!!
I understood it.

[nassau-tk]

I tested to check the Real PSP's kr0.pgf header by pgftool.

Result.
"Can't read it."
jpn0.pgf / ltn0.pgf~ltn15.pgf is OK.(It can read header.)
But,It's no responsed on pgftool only "kr0.pgf" .
I don't know why.:tired_face:

[nassau-tk]

@Panderner
Hi!!
Comming "Time of Test "!!
Can you?

I have begun to consider a possibility of "the problem of a PGF file" by the other day's test.
Point is 2 things.These point was move my making mind.

1. A few Hangul appeared on my test file .
2. Real PSP's kr0.pgf couldn't dump.(not appear error code. just through.)

https://drive.google.com/file/d/1X31Eea5_LTEkoPxBmjZfGGis1Z-ZScSn/view?usp=sharing

I don't know about "Hangul".
So everything is made by "only my sense".
If appear the Hangul then it's good.
But I think it can't be adjusted small.

If you have interest then let's try it and please give me report.:construction_worker:

[nassau-tk]

@hrydgard

If appeared the Hangul characters by this pgf file then we need rethink about the issue tag change or add "PGF / Scefont" don't you?

Of course,If Hangul "appear".:grin:

[Panderner]

@Panderner
Hi!!
Comming "Time of Test "!!
Can you?

I have begun to consider a possibility of "the problem of a PGF file" by the other day's test.
Point is 2 things.These point was move my making mind.

1. A few Hnagul appeared on my test file .
2. Real PSP's kr0.pgf couldn't dump.(not appear error code. just through.)

https://drive.google.com/file/d/1X31Eea5_LTEkoPxBmjZfGGis1Z-ZScSn/view?usp=sharing

I don't know about "Hangul".
So everything is made by "only my sense".
If appear the Hangul then it's good.
But I think it can't be adjusted small.

If you have interest then let's try it and please give me report.👷

@nassau-tk that font can cause issues for LocoRoco and Gran Turismo:

Korean text in Gran Turismo is spammed by same letters:

and here's LocoRoco 2 and LocoRoco Midnight Carnival the all letters stretched horizontally and warning screen still not aligned correctly:

[nassau-tk]

@Panderner

#13458 (comment)
GranTurismo is needs turn off "Lazy texture caching (speedup)" option.
Maybe you turn on the option's check box aren't you?
Please Check & ReTest it.

LocoLoco...um...
It seems shrinking about half size(horizonal).
It has possible to fix.(Maybe)

How about BlazBlue?
Not good?

[nassau-tk]

@hrydgard
These result means that the issue was happened by "PGF files" I think.
How do you think about this?

This is an amature's idea (Delusion) below.:smile:
For example.

• Real PSP's kr0.pgf has locked or encryption. (Only This pgf?)
• And,PPSSPP has not key of decrypt.

[hrydgard]

I am just thoroughly confused here :) Really no idea what's going on with kr0.pgf.

There might be bugs in our implementation of sceFont, too...

[nassau-tk]

😆

I feel that most strange point is "Can't see header only kr0.pgf by pgftool's dump".
But,other pgf files has no major problem now.

So,We should think light.
Like this.
"If we fixed about kr0.pgf then we will free from all about pgf issue! "(Imprudent?:sunglasses:)

Well,I will think how to way this issue solved.

[nassau-tk]

@hrydgard

There might be bugs in our implementation of sceFont, too...

I think that's "Right".
See,below link.
#11055
This issue will happening when loading plural PGF files I think.
It should loaded "jpn0.pgf & ltn15.pgf".
But "ltn15.pgf" is not load.

Well,I will try some font making.

P.S:Please rethink about tag about this issue.

[Panderner]

@Panderner

#13458 (comment)
GranTurismo is needs turn off "Lazy texture caching (speedup)" option.
Maybe you turn on the option's check box aren't you?
Please Check & ReTest it.

LocoLoco...um...
It seems shrinking about half size(horizonal).
It has possible to fix.(Maybe)

How about BlazBlue?
Not good?

I've tried turned off lazy cache texturing and it worked

[nassau-tk]

@hrydgard

Well,What should we do?

Note : I will sleep tonight.Good night!

[hrydgard]

We shall merge your new kr0 font :)

[nassau-tk]

@hrydgard
Morning came in Japan!!
And, Thank you for merging it!!

Well,My Font Working is finished roughlly isn't it?

[Panderner]

The @nassau-tk's latest kr0.pgf is merged but please do not close this issue until the real PSP's kr0.pgf is fixed.

[nassau-tk]

Yes, Right!

[nassau-tk]

@hrydgard
I propose for you that this issue should be "PGF / sceFont" tag.
How do you think about it?

[hrydgard]

That's right! I changed the tag.

[Panderner]

This is the real PSP's kr0.pgf

[nassau-tk]

I checked by PSP (Real Device).
Maybe,The original kr0.pgf would not corrupted.

[ Testing on Real PSP Device & Real PGF Fonts. ]
Of course,"No problem!!"
See those screen shots below.

[ Talking on PPSSPP. ]
And,Even If deleted the kr0.pgf from PPSSPP then The game is can boot.
Not become "Invalid Memory Access Error".
Maybe,If PPSSPP is missing kr0.pgf then it would loading "jpn0.pgf".
If it was installed the "Real PSP's kr0.pgf" then PPSSPP can't load the "kr0.pgf".
So,It will loading jpn0.pgf for the substitution of kr0.pgf.
Can't load the "kr0.pgf" = PPSSPP is missing the PGF.

Then not appear the korean characters and appear the "_ (Underline)."
It's meaning "The inside of font file(=jpn0.pgf) has not the Korean character."(Of course, Korean isn't included.)

[ An amature's thinking. ]
So,I think the cause of issue is PPSSPP will not loading kr0.pgf's "header".
pgftool couldn't read only the header infomation of Real PSP's kr0.pgf .
This is the point that I'm very interested.

How do you think about it?

[nassau-tk]

@hrydgard

I got a answer for kr0.pgf from @tpunix .
Please, See below.
tpunix/pgftool#4

[hrydgard]

Oh, that's interesting. Makes sense given that Korean characters consists of groups of smaller characters and there are many, many combinations... so they save space by combining them. Means that getting real korean font to work in PPSSPP will probably be very challenging...

[nassau-tk]

But...Why my font is working?
I'm not making that Korean puzzle font.
It was made by same way with other pgf.
That's "Unicode font".
Hm...I can't understand!!

[nassau-tk]

By the way.
Should we make system priority that our custom kr0.pgf higher priority than flash0>kr0.pgf on Android?

And, In other OS...How should do to avoidance?

How do you think?

[hrydgard]

Your font is working because you have generated it like the other fonts, and we use our own PGF implementation that can read "normal" fonts that are not made of many small pieces.

So yes, we should not recommend to use original kr0.pgf until we figure out how it works...

[Panderner]

I don't think we need a decryption of original kr0.pgf.

[anr2me]

Oh, that's interesting. Makes sense given that Korean characters consists of groups of smaller characters and there are many, many combinations... so they save space by combining them. Means that getting real korean font to work in PPSSPP will probably be very challenging...

Constructing Hangeul syllables from glyphs like this? https://glyphsapp.com/learn/creating-a-hangeul-font

Congratulations! You made your first “in-frame style” Hangeul syllable! 
Now, just repeat the process for all 2,780 basic Hangeul syllables, and you’ll be done. 
Easy, right?

[hrydgard]

Yeah, it's gotta be something like that. How that is represented in the font format, or what lookup tables you need to put them together, I have no idea...

[nassau-tk]

Me too...

[anr2me]

Looks like arib is even more complicated (ie. too many glyphs) than kr0 font :D https://github.com/libcg/intraFont-G

font:   ¦ INTRAFONT_CACHE_MED (def) ¦  INTRAFONT_CACHE_LARGE  ¦ INTRAFONT_CACHE_ASCII ¦  INTRAFONT_CACHE_ALL
--------+---------------------------+-------------------------+-----------------------+--------------------------
ltn0-7  ¦   52ms,  114kB, 2.5kCPS(*)¦   52ms,  210kB, 2.5kCPS ¦  83ms, 33kB, 100kCPS  ¦  191ms, 119kB, 100kCPS
ltn8-15 ¦   36ms,   83kB, 4.1kCPS   ¦   36ms,  179kB, 4.1kCPS ¦  54ms, 20kB, 100kCPS  ¦   95ms,  64kB, 100kCPS
jpn0    ¦ 1020ms, 1763kB, 0.5kCPS   ¦ 1020ms, 1859kB, 0.5kCPS ¦ 997ms, 33kB, 100kCPS  ¦   - too many glyphs -
kr0     ¦  350ms,  625kB, 0.6kCPS   ¦  350ms,  721kB, 0.6kCPS ¦  - no ASCII glyphs -  ¦ 1936ms, 440kB, 67kCPS(**)
arib    ¦  177ms,  266kB, 1.9kCPS   ¦  177ms,  362kB, 1.9kCPS ¦  - no ASCII glyphs -  ¦   - too many glyphs -
--------+---------------------------+-------------------------+-----------------------+--------------------------
(*)  Low speeds (<10kCPS) occur when characters are not cached. Printing the same characters a second time 
     results in 100 kCPS, i.e. the speed penalty is gone.
(**) kr0 is slower because one character can consist of up to three glyphs.

[nassau-tk]

@hrydgard

I think that we should put on "Future milestone" about this "Can't load the original kr0.pgf" issue.
Of course, At first we must thinking about "should solve? or not?".

@anr2me
I can't understand to reason of exist of "arib.pgf". 😄
It's included "Special mark" more than 50%.

[arib.pgf / Animation Gif.]