[592] Map Data / XTEAs

I am currently testing out the 592 Matrix port and planning to use it as a reference to port Hyperion over to 592 as well.

While walking around though, I noticed certain areas (northwest ardougne, for example) are missing. Warrior's guild also crashes client with an index out of bounds (not sure if related). I'm sure there are other locations with these issues.

The viability of the server I'd like to create relies on having most of the world's mapdata.

Are there more xteas / mapdata out there than what exists in the Matrix 592 post?


I tried repacking the packed.mcx file with the xteas from here: [Only registered and activated users can see links. Click Here To Register...]

And then it was behaving as if there was zero mapdata :(


*edit* after spending more time with this, I noticed that these regions were already blocked out on the map from openrs2 for 592. So, it sounds like that northwest ardy (and others) will just have to remain blank without cache editing, eh?

AFAIK, in the 592 release by _jordan/sushi, most of the maps were decrypted and repacked in the cache (and need [0, 0, 0, 0] as keys). You could download an XTEA validator and check if any of the OpenRS2 keys work for the remaining encrypted areas.

Use this [Only registered and activated users can see links. Click Here To Register...]. I did not test and haven't used in a while however I believe this is the cache directly from RuneForged. It is not the same cache from [Only registered and activated users can see links. Click Here To Register...] thread. This contains more maps. And like Alex said, the maps are decrypted so you do not use any xtea keys and you send 0's in the map packet instead of the 4 xtea keys.

I remember Port Phasmatys being also an area that was missing. I remember at one point going around and patching all the missing areas.

[Only registered and activated users can see links. Click Here To Register...]

Quote:

---

Originally Posted by _jordan [Only registered and activated users can see links. Click Here To Register...]

Use this [Only registered and activated users can see links. Click Here To Register...]. I did not test and haven't used in a while however I believe this is the cache directly from RuneForged. It is not the same cache from [Only registered and activated users can see links. Click Here To Register...] thread. This contains more maps. And like Alex said, the maps are decrypted so you do not use any xtea keys and you send 0's in the map packet instead of the 4 xtea keys.

I remember Port Phasmatys being also an area that was missing. I remember at one point going around and patching all the missing areas.

---

This is super helpful thank you!

Client crashes on load now though (pre-login @ Loaded client variable data) :( Wonder if something is missing in this cache that the other cache has? I seriously need to grow a deeper understanding of how rs cache works at some point...

Quote:

---

Error: iv.UA(126) rd.J({...},5,-2) rd.H({...},95) wf.F(202,0) sh.G(104,40,104,{...},-40,255) kv.E(125) client.TA(0) client.P(57) o.R(8101) | BufferStream.readUnsignedShort:808 Class185.method1214:491 Class185.method1217:865 Class251.method1610:146 Class64_Sub1.method2220:125 Class246_Sub1_Sub13.method2695:93 client.method2970:622 client.method2938:327 Class_o.method2936:110 Class_o.run:609 java.lang.Thread.run:748 | java.lang.ArrayIndexOutOfBoundsException: 15 | [1)2904,3176,104,104|2)0,2912,3184|3)0|4)0|5)1|6)76 5,503|7)false|8)0|9)true|10)false|11)false|12)true |13)14529|]

---

Quote:

---

Originally Posted by Displee [Only registered and activated users can see links. Click Here To Register...]

[Only registered and activated users can see links. Click Here To Register...]

---

I've been away from RSPS for a long time and my understanding of how maps / cache / xteas work has never been great, but at a high-level, how could I go about using xteas from other revisions if the cache already has maps decrypted (with some missing data)?

Quote:

---

Originally Posted by Scary Kidz [Only registered and activated users can see links. Click Here To Register...]

This is super helpful thank you!

Client crashes on load now though (pre-login @ Loaded client variable data) :( Wonder if something is missing in this cache that the other cache has? I seriously need to grow a deeper understanding of how rs cache works at some point...





I've been away from RSPS for a long time and my understanding of how maps / cache / xteas work has never been great, but at a high-level, how could I go about using xteas from other revisions if the cache already has maps decrypted (with some missing data)?

---

For each region (64x64), there's 1 file in the cache for map data and a 2nd one for land data (and some other ones if you're using very old revs: [Only registered and activated users can see links. Click Here To Register...]). The land data is the one that's encrypted with XTEA keys (4X32-bit integers). If you're missing the XTEA keys for the land data of a region, you will need to find another lower/higher revision cache that has this region + the XTEA keys for the specific region/cache and then repack the decrypted land data of that cache into your other cache. You can also fetch them from the cache without XTEA keys starting from revision 764 since they stopped encrypting land data with keys from that revision onwards.

Once you have the XTEA keys for a region, you can fetch the land data from the cache and repack it without key encryption. Then you never need XTEA keys again and you can send blank 0s for the keys when you build the (dynamic) map packet.

Quote:

---

Originally Posted by Scary Kidz [Only registered and activated users can see links. Click Here To Register...]

This is super helpful thank you!

Client crashes on load now though (pre-login @ Loaded client variable data) :( Wonder if something is missing in this cache that the other cache has? I seriously need to grow a deeper understanding of how rs cache works at some point...





I've been away from RSPS for a long time and my understanding of how maps / cache / xteas work has never been great, but at a high-level, how could I go about using xteas from other revisions if the cache already has maps decrypted (with some missing data)?

---

That cache might be the osrs variant since it's crashing while loading objects but not sure. My vanilla 592 cache with the fixed maps may have been lost to time but it isn't a hard fix. I used Displee's little program to add missing maps.

Quote:

---

Originally Posted by _jordan [Only registered and activated users can see links. Click Here To Register...]

That cache might be the osrs variant since it's crashing while loading objects but not sure. My vanilla 592 cache with the fixed maps may have been lost to time but it isn't a hard fix. I used Displee's little program to add missing maps.

---

Which program is that?

Quote:

---

Originally Posted by clem585 [Only registered and activated users can see links. Click Here To Register...]

Which program is that?

---

[Only registered and activated users can see links. Click Here To Register...]

Quote:

---

Originally Posted by _jordan [Only registered and activated users can see links. Click Here To Register...]

That cache might be the osrs variant since it's crashing while loading objects but not sure. My vanilla 592 cache with the fixed maps may have been lost to time but it isn't a hard fix. I used Displee's little program to add missing maps.

---

I've spent the day checking between displee's and openrs2 xteas and did get a few extra regions to work (camelot and bottom half of tree gnome village for example) but northwest ardy isn't valid in any of the closest revisions :(

Have identified a few (lower, to avoid any ids being > 592 ids) revisions that contain some missing mapdata that matters. Closest are:

Quote:

---

Rev 578 has NW Ardougne (40_52)
Rev 569 has Grand Tree 38_54 and the missing brimhaven maps (43_47, 44_46) as well as both missing ardougne pieces (40_52, 41_52) and port phasmatys (57_54)

---

If I understand correctly, I'll need to either:

Load donor revision's cache. Decrypt the maps I need w/ valid xteas, extract them, and repack them into the 592 cache

Or

Load donor revision's cache. Extract the encrypted maps and repack them into 592 cache overwriting 592's data for those indexes. Decrypt in 592 using the valid donor revision's cache.

Does that sound correct? I'm not sure if I understand the process of extracting/injecting cache data from/to any given revision or what tools are out there for it, but maybe this is something that might be worth paying someone to do and explain how they did it :santa_hat:

Thank you guys for all of the insight, almost every response has been super helpful in its own way :D

Quote:

---

Originally Posted by Scary Kidz [Only registered and activated users can see links. Click Here To Register...]

I've spent the day checking between displee's and openrs2 xteas and did get a few extra regions to work (camelot and bottom half of tree gnome village for example) but northwest ardy isn't valid in any of the closest revisions :(

Have identified a few (lower, to avoid any ids being > 592 ids) revisions that contain some missing mapdata that matters. Closest are:



If I understand correctly, I'll need to either:

Load donor revision's cache. Decrypt the maps I need w/ valid xteas, extract them, and repack them into the 592 cache

Or

Load donor revision's cache. Extract the encrypted maps and repack them into 592 cache overwriting 592's data for those indexes. Decrypt in 592 using the valid donor revision's cache.

Does that sound correct? I'm not sure if I understand the process of extracting/injecting cache data from/to any given revision or what tools are out there for it, but maybe this is something that might be worth paying someone to do and explain how they did it :santa_hat:

Thank you guys for all of the insight, almost every response has been super helpful in its own way :D

---

Use this if you're using that Matrix 592 server.

Code:

---

public class MapTool {

        public static final int VERSION = 562;// we can pull maps from other revisions.

        public static final int[] REGIONS = new int[] { 9782, 9781 };

        public static void main(String[] args) {
                boolean result;
                try {
                        MapXTEAS.init();

                        var fromCache = new Store(System.getProperty("user.home") + "/Documents/592/from/");
                        var toCache = new Store(Constants.CACHE_PATH);

                        var toIndex = toCache.getIndexes()[CacheIndex.MAPS];
                        var fromIndex = fromCache.getIndexes()[CacheIndex.MAPS];

                        for (int regionId : REGIONS) {
                                int regionX = (regionId >> 8) * 64;
                                int regionY = (regionId & 0xff) * 64;
                                String name;

                                name = "m" + ((regionX >> 3) / 8) + "_" + ((regionY >> 3) / 8);
                                byte[] data = fromIndex.getFile(fromIndex.getArchiveId(name));
                                if (data == null)
                                        data = toIndex.getFile(toIndex.getArchiveId(name));
                                if (data != null) {
                                        result = addMapFile(toIndex, name, data);
                                        System.out.println(name + ", " + result);
                                }

                                name = "um" + ((regionX >> 3) / 8) + "_" + ((regionY >> 3) / 8);
                                data = fromIndex.getFile(fromIndex.getArchiveId(name));
                                if (data == null)
                                        data = toIndex.getFile(toIndex.getArchiveId(name));
                                if (data != null) {
                                        result = addMapFile(toIndex, name, data);
                                        System.out.println(name + ", " + result);
                                }

                                int[] xteas = MapXTEAS.MAP.get(VERSION)[regionId];

                                name = "l" + ((regionX >> 3) / 8) + "_" + ((regionY >> 3) / 8);
                                data = fromIndex.getFile(fromIndex.getArchiveId(name), 0, xteas);
                                if (data != null) {
                                        result = addMapFile(toIndex, name, data);
                                        System.out.println(name + ", " + result);
                                }

                                name = "ul" + ((regionX >> 3) / 8) + "_" + ((regionY >> 3) / 8);
                                data = fromIndex.getFile(fromIndex.getArchiveId(name), 0, xteas);
                                if (data != null) {
                                        result = addMapFile(toIndex, name, data);
                                        System.out.println(name + ", " + result);
                                }

                                name = "n" + ((regionX >> 3) / 8) + "_" + ((regionY >> 3) / 8);
                                data = fromIndex.getFile(fromIndex.getArchiveId(name), 0);
                                if (data == null)
                                        data = toIndex.getFile(toIndex.getArchiveId(name), 0);
                                if (data != null) {
                                        result = addMapFile(toIndex, name, data);
                                        System.out.println(name + ", " + result);
                                }

                                toIndex.rewriteTable();
                        }
                } catch (Exception e) {
                        e.printStackTrace();
                }

                System.out.println("Replaced region(s): " + Arrays.toString(REGIONS));
        }

        private static boolean addMapFile(Index index, String name, byte[] data) {
                int archiveId = index.getArchiveId(name);
                if (archiveId == -1)
                        archiveId = index.getTable().getValidArchiveIds().length;
                return index.putFile(archiveId, 0, 2, data, null, false, false, name.toLowerCase().hashCode(), -1);
        }

}

---

Quote:

---

Originally Posted by _jordan [Only registered and activated users can see links. Click Here To Register...]

Use this if you're using that Matrix 592 server.

Code:

---

public class MapTool {

        public static final int VERSION = 562;// we can pull maps from other revisions.

        public static final int[] REGIONS = new int[] { 9782, 9781 };

        public static void main(String[] args) {
                boolean result;
                try {
                        MapXTEAS.init();

                        var fromCache = new Store(System.getProperty("user.home") + "/Documents/592/from/");
                        var toCache = new Store(Constants.CACHE_PATH);

                        var toIndex = toCache.getIndexes()[CacheIndex.MAPS];
                        var fromIndex = fromCache.getIndexes()[CacheIndex.MAPS];

                        for (int regionId : REGIONS) {
                                int regionX = (regionId >> 8) * 64;
                                int regionY = (regionId & 0xff) * 64;
                                String name;

                                name = "m" + ((regionX >> 3) / 8) + "_" + ((regionY >> 3) / 8);
                                byte[] data = fromIndex.getFile(fromIndex.getArchiveId(name));
                                if (data == null)
                                        data = toIndex.getFile(toIndex.getArchiveId(name));
                                if (data != null) {
                                        result = addMapFile(toIndex, name, data);
                                        System.out.println(name + ", " + result);
                                }

                                name = "um" + ((regionX >> 3) / 8) + "_" + ((regionY >> 3) / 8);
                                data = fromIndex.getFile(fromIndex.getArchiveId(name));
                                if (data == null)
                                        data = toIndex.getFile(toIndex.getArchiveId(name));
                                if (data != null) {
                                        result = addMapFile(toIndex, name, data);
                                        System.out.println(name + ", " + result);
                                }

                                int[] xteas = MapXTEAS.MAP.get(VERSION)[regionId];

                                name = "l" + ((regionX >> 3) / 8) + "_" + ((regionY >> 3) / 8);
                                data = fromIndex.getFile(fromIndex.getArchiveId(name), 0, xteas);
                                if (data != null) {
                                        result = addMapFile(toIndex, name, data);
                                        System.out.println(name + ", " + result);
                                }

                                name = "ul" + ((regionX >> 3) / 8) + "_" + ((regionY >> 3) / 8);
                                data = fromIndex.getFile(fromIndex.getArchiveId(name), 0, xteas);
                                if (data != null) {
                                        result = addMapFile(toIndex, name, data);
                                        System.out.println(name + ", " + result);
                                }

                                name = "n" + ((regionX >> 3) / 8) + "_" + ((regionY >> 3) / 8);
                                data = fromIndex.getFile(fromIndex.getArchiveId(name), 0);
                                if (data == null)
                                        data = toIndex.getFile(toIndex.getArchiveId(name), 0);
                                if (data != null) {
                                        result = addMapFile(toIndex, name, data);
                                        System.out.println(name + ", " + result);
                                }

                                toIndex.rewriteTable();
                        }
                } catch (Exception e) {
                        e.printStackTrace();
                }

                System.out.println("Replaced region(s): " + Arrays.toString(REGIONS));
        }

        private static boolean addMapFile(Index index, String name, byte[] data) {
                int archiveId = index.getArchiveId(name);
                if (archiveId == -1)
                        archiveId = index.getTable().getValidArchiveIds().length;
                return index.putFile(archiveId, 0, 2, data, null, false, false, name.toLowerCase().hashCode(), -1);
        }

}

---

---

Thank you so much for this :wub:

If I can get the missing maps I care about working and packed into the 592 cache I'll release it so you and anyone else who may want it don't have to go through this whole process.

Goal is to fill in the blanks for BrimHaven / Shilo Village, Ape Atoll, Ardy, Grand Tree, DK tunnels, Desert, Port Phasmatys, missing minigame regions, and any dungeons/caves/islands that are not quest specific :)

Quote:

---

Originally Posted by AceKingSuited [Only registered and activated users can see links. Click Here To Register...]

Thank you so much for this :wub:

If I can get the missing maps I care about working and packed into the 592 cache I'll release it so you and anyone else who may want it don't have to go through this whole process.

Goal is to fill in the blanks for BrimHaven / Shilo Village, Ape Atoll, Ardy, Grand Tree, DK tunnels, Desert, Port Phasmatys, missing minigame regions, and any dungeons/caves/islands that are not quest specific :)

---

That would be nice, I've been hand-picking map xtea from other caches.

Quote:

---

Originally Posted by Natalynn [Only registered and activated users can see links. Click Here To Register...]

That would be nice, I've been hand-picking map xtea from other caches.

---

[Only registered and activated users can see links. Click Here To Register...]

Quote:

---

Originally Posted by _jordan [Only registered and activated users can see links. Click Here To Register...]

[Only registered and activated users can see links. Click Here To Register...]

---

Ooh, didn't think it was already out. Thanks :).