Add cpio binary and help with silent and parallel builds

[srikard]

Sometimes kernel build fails due to non availability of cpio archive in the container.
the kernel/gen_kheaders.sh file needs cpio archive to build kernel/kheaders_data.tar.xz

Similarly silent and parallel builds will help to build faster and show only relevant warnings or error messages.

[a13xp0p0v]

Hello @srikard,

Thanks a lot for your pull request! I like the idea.

I agree that parallel build should become default.
But we should provide a parameter for make_linux.py for disabling it and having a single-thread build (there are cases when it's useful).
Could you please implement a -t (single Tread build) parameter for make_linux.py?

And I think that verbose kernel build should stay default.
Could you please add a -q (quiet) parameter for make_linux.py for silent build?

Would you like to work on it?

[srikard]

* Alexander Popov ***@***.***> [2024-09-04 08:02:35]:

Hello @srikard, Thanks a lot for your pull request! I like the idea. I agree that parallel build should become default. But we should provide a parameter for `make_linux.py` for disabling it and having a single-thread build (there are cases when it's useful). Could you please implement a `-t` (single Tread build) parameter for `make_linux.py`? And I think that verbose kernel build should stay default. Could you please add a `-q` (quiet) parameter for `make_linux.py` for silent build? Would you like to work on it?

Okay, will do, However may not be immediately though. Also I think its better to keep the options compatible with kernel makefile where possible. something like -s for silent and -j for parallel build.

…

-- Reply to this email directly or view it on GitHub: #20 (comment) You are receiving this because you were mentioned. Message ID: ***@***.***>

-- Thanks and Regards Srikar Dronamraju

[a13xp0p0v]

The -s parameter is already used for source path. So I would recommend -q like quiet.

The -j parameter doesn't fit: we need parallel build as default behavior for make_linux.py (without parameters).
So we need a make_linux.py parameter for a single-tread build, corresponding to make -j1. How about -t (single Tread build). Any other ideas?

[a13xp0p0v]

Hello @srikard,

I've finished the implementation and merged this branch: c9a015c.

Finally, the feature looks like this:

+    parser.add_argument('-q', action='store_true',
+                        help='for running `make` in quiet mode')
+    parser.add_argument('-t', action='store_true',
+                        help='for running `make` in single-threaded mode (multi-threaded by default)')
     parser.add_argument('make_args', metavar='...', nargs=argparse.REMAINDER,
                         help='additional arguments for \'make\', can be separated by -- delimiter')
     args = parser.parse_args()
@@ -197,6 +201,19 @@ def main():
                 sys.exit('[-] Don\'t specify "CROSS_COMPILE=", we will take care of that')
             if arg.startswith('CC='):
                 sys.exit('[-] Don\'t specify "CC=", we will take care of that')
+            if arg.startswith('-j'):
+                sys.exit('[-] Don\'t specify "-j", by default we run \'make\' in parallel on all CPUs')
+
+    if args.q:
+        print('[+] Going to run \'make\' in quiet mode')
+        make_args.insert(0, '-s')
+
+    if not args.t:
+        cpu_count = os.sysconf('SC_NPROCESSORS_ONLN')
+        print(f'[+] Going to run \'make\' on {cpu_count} CPUs')
+        make_args = ['-j', str(cpu_count)] + make_args
+    else:
+        print(f'[+] Going to run \'make\' in single-threaded mode')
 
     build_kernels(args.a, args.k, args.s, args.o, compilers, make_args)

Does it work for you?

[srikard]

* Alexander Popov ***@***.***> [2024-09-18 17:42:36]:

Hello @srikard, I've finished the implementation and merged this branch. Does it work for you?

Tested it out, and it works well. Thanks for adding this

…

-- Reply to this email directly or view it on GitHub: #20 (comment) You are receiving this because you were mentioned. Message ID: ***@***.***>

-- Thanks and Regards Srikar Dronamraju