Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automate Debian Package generation for Ubuntu apt repos #2537

Open
1 of 5 tasks
AndrewQuijano opened this issue Nov 4, 2024 · 7 comments
Open
1 of 5 tasks

Automate Debian Package generation for Ubuntu apt repos #2537

AndrewQuijano opened this issue Nov 4, 2024 · 7 comments
Labels
build & packaging Build system and packaging related Ubuntu/Debian Linux - Distribution

Comments

@AndrewQuijano
Copy link
Contributor

Feature

  • New architecture module
  • Support for processor extension
  • Add more instruction details (elaborated below)
  • Binding support for: language
  • Other (elaborated below)

Describe the feature you'd like
I will work on this on another PR, but this is based on #2398. But to better leverage CI to help automate your team to provide Ubuntu the latest packages, I would like to automate the process of creating newer 'libcapstone-dev' and 'libcapstone5/6' Debian packages.

382488425-7c5a9754-73ed-43bf-8735-81284ecf766c
382488620-6902f630-3b1f-4bc3-ba50-fba71c566dae

To help you with the PR to get this work, I suspect the main solution is to get the following:

1- When I used apt to check information, where is that data coming from? Is that from capstone.pc? How did you create the Debian packages before used by the Ubuntu repository for apt?

2- To create two separate Debian packages, how should I do this? From my understanding, this means that libcapstone-dev will have just the header files, and another will include the library files?

Either way, if I can get guidance on this, I can do the work on getting the PR and tests for both Debian packages. Then on the releases, we can just get two Debian packages, which can easily just be handed over to Ubuntu apt managers.

P. S.
@Rot127 Could you please create Debian 5.0.4 release with the Debian package? I'd like to start updating PANDA to use this.

Also, whenever we got the PR merged, you want to update documentation to either check Releases and point to a libcapstone5, etc.
http://www.capstone-engine.org/documentation.html

Additional context
N/A.

@AndrewQuijano AndrewQuijano changed the title Automa Automate Debian Package generation for Ubuntu apt repossitories Nov 4, 2024
@AndrewQuijano AndrewQuijano changed the title Automate Debian Package generation for Ubuntu apt repossitories Automate Debian Package generation for Ubuntu apt repos Nov 4, 2024
@AndrewQuijano
Copy link
Contributor Author

Keeping track of this to better plan the PR and help with answering my questions
image

image

@Rot127 Rot127 added the build & packaging Build system and packaging related label Nov 6, 2024
@Rot127
Copy link
Collaborator

Rot127 commented Nov 6, 2024

1- When I used apt to check information, where is that data coming from? Is that from capstone.pc?

No idea. But either from there or from debian/control I guess.

How did you create the Debian packages before used by the Ubuntu repository for apt?

I don't know actually. The package was added to the Ubuntu repositories by someone else years ago. I am not familiar with the process tbh.

2- To create two separate Debian packages, how should I do this? From my understanding, this means that libcapstone-dev will have just the header files, and another will include the library files?

Yeah, this is the common pattern for -dev packages in my experience.

Either way, if I can get guidance on this, I can do the work on getting the PR and tests for both Debian packages.

As said above. I would also need to read myself into it. And I currently don't have the time, sadly.
This looks like a good description of the process.

@Rot127 Could you please create Debian 5.0.4 release with the Debian package? I'd like to start updating PANDA to use this.

You mean a release in the repo here, right?
We do a patch release of v6-Alpha-1 soon (weekend hopefully).

@AndrewQuijano
Copy link
Contributor Author

Oh, I meant that if I can get a 5.0.4, currently PANDA uses libcapstone5, and we can just get the Debian package from the release. I figure this would be helpful for everyone else using libcapstone5 too.

https://github.com/capstone-engine/capstone/releases/tag/5.0.3

I can work on the packages, I will just create two new folders to have very similar behavior to make the new Debian packages. I figure we can leave it as future work to see how to get the Debian packages into apt repositories, but please keep me posted on that.

@AndrewQuijano
Copy link
Contributor Author

@Rot127, for version 6 Debian package creation, I haven't tested passing in an argument like 6.0.0-Alpha1, it works with a v6.0.1 or 6.0.1

@Rot127
Copy link
Collaborator

Rot127 commented Nov 10, 2024

I haven't tested passing in an argument like 6.0.0-Alpha1, it works with a v6.0.1 or 6.0.1

I think Debian packages are not allowed to be an alpha. But you can check the name with dpkg-name apparently.

@Rot127 Rot127 added the Ubuntu/Debian Linux - Distribution label Nov 10, 2024
@AndrewQuijano
Copy link
Contributor Author

Yeah, the script needs a bit of updating on version checking, but it seems you can put 6.0.0-alpha as a Version for Debian Packages.

Please keep me posted on action items needed to go to full Debian repository, but the more I think about it, it might be easier just to scrap having a 'libcapstone' and 'libcapstone-dev', and just use a 'libcapstone-dev'. I can work on it, and I already have the control file, not sure what else is needed, but keep me posted.

@AndrewQuijano
Copy link
Contributor Author

AndrewQuijano commented Nov 10, 2024

Copying this to note for myself here

I looked into your questions in detail and found actually more than one problem. I am sorry that I did not review more thoroughly before. I also never worked with deb packages until now, was in a rush due to other things and oversaw quite some problems.
Thank you for asking about these problems, otherwise I would have missed them.

The issues I found are the following:

We didn't added all mandatory fields to the control file.

  • Architecture in the control file was incorrectly set to all.
  • As you already said, the package should be installed into /usr/.
  • The generated package misses the dependency information.
  • The package name was not according to the Debian standard.
  • Hash sums missing

I tried fixing some of them, but quickly recognized that it gets out of hand quickly. And for Capstone we need a more complete approach.

As it looks like, the original script, you used as a basis, was never meant to generate a deb package for the official Debian/Ubuntu repositories. This would also explain why it was lacking so many things.

Unfortunately, we cannot provide a package which is this much incomplete for the release. In #2543 I removed it from the release CI, but kept your work in packages/deb/. Also you can trigger the package build by dispatching the new Build Debian Package workflow.

If you want to have a deb package in the official Ubuntu/Debian repositories, I would ask you to do the implementation from scratch. This time though by using CPack. And with CPack we can also generate packages for other distros. Also we have a certain guarantee that the built packages are correct.
If you do so, please first submit the package to the Debian packages and wait for approval. Then we can merge it here.

https://www.debian.org/doc/manuals/maint-guide/

https://wiki.debian.org/DebianMentorsFaq

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build & packaging Build system and packaging related Ubuntu/Debian Linux - Distribution
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants