AcarsDeco2 Development

[Hobbyd]

Hi Sergsero,

Version v.20170914 up and running.

Two observations:
1. again got a large set of "AircraftCache::getAircraftsList(): regno in DB but not in cache" messages.
The time of the first one again equeals to the time of an "Message label: SQ" message.
That cannot be a coincidence, can it ;-)

2. I was trying to get a logfile without any prefix.
So I tried this:
--logfile /home/pi/acarsdeco2_test/logs/
which resulted in this:
-20170917-115027.log

Would it be possible to remove the "-" when the --logfile option only contains a directory name?

PS.
I very much like the INFO records in the process log like these:

2017-09-17 11:50:21.707  INFO     outConnectUdp(PP:10.0.1.2:9742) started
2017-09-17 11:50:22.305  INFO     outConnectUdp(PP:10.0.1.2:9742) start sending

Very helpfull.

Cheers,
Dick

[Radio2.0]

In my area there are only 3 active acars freq's and I have them configured like this:
"--freq 131525000 131725000 131825000" which works fine.

In Europe normally more freq are in use.
There are also ACARS on 136.XXX

I note, that unfortunately, in my area not available for receiving messages from ground stations (ground-to-air) and the associated functionality is not tested in practice.

is there a list where the upload station are? On the Airport?

Data output to file in CSV will be realized in next versions.

pls add an option to have monthly files like: 010917.csv for better storage.

[shall698]

Evangel,

Can you tell me please? Do you already have aircraft pictures in your folder f:\db\pictures?

Or is it finding them from online source?

Thanks in advance.

shall





quote author=evangel link=topic=3182.msg35214#msg35214 date=1503624213]
Hi Sergsero

excellent work ! works ok my end with

Code Select Expand

cmd /c acarsdeco2.exe --gain 38.6 --freq-correction -9 --http-port 8282 --vrs-url http://127.0.0.1:8484 --db f:\db\bs.sqb --frdb f:\db\fr.sqb --silhouettes f:\db\silhouettes --pictures f:\db\pictures --banners f:\db\logos --outServer ad2:31108  --freq 131550000 131725000 130450000 131475000 --logfile c:\adsb\acarsdeco2017\acars.log





A nice add-on will be to have a 'Log Playback'  feature/button.

brgds/evangel
[/quote]

[shall698]

Radio 2 / Segsero,

When i enter frequencies based in the 136600000 range it shows frequency out of range!

Please help.

shall

In my area there are only 3 active acars freq's and I have them configured like this:
"--freq 131525000 131725000 131825000" which works fine.

In Europe normally more freq are in use.
There are also ACARS on 136.XXX

I note, that unfortunately, in my area not available for receiving messages from ground stations (ground-to-air) and the associated functionality is not tested in practice.

is there a list where the upload station are? On the Airport?

Data output to file in CSV will be realized in next versions.

pls add an option to have monthly files like: 010917.csv for better storage.

[evangel]

@ shall698

whenever i see an aircraft that interest me (in VRS) i save an image (.jpg) then transfer it to /pictures folder.

regarding the frequencies, they cannot be spaced to more than 1 Mhz. that is you can have 4 frequencies in the 131.nnn range or 136.nnn range, but not 2 on 131.nnn and 2 on 136.nnn

brgds

[Jonas300]

Hello!

I have a question how to change the callsign? From, for example, SN055W (DAT55W) in (BEL55W) ?? or
X3000 (HLX0000) in (TUI0000)
CL... in (CLH...)
A3... in (AEE...)
..
Thanks

[Radio2.0]

  yes that is a huge problem!

I use an "old" Version of ACARSdeco2 where it works.

[sergsero]

Hi,

The new version of the program in which I tried to implement some requests.

- Added option providing the ability to export messages to disk as comma separated value (CSV) files.
  It has two types:
--logfile-sbs <arg> for export original ACARS messages and
--logfile-esbs <arg> - the same with additional information from reference data sources.
  The argument requires a full path to and file name. The program will add a time stamp to the beginning and extension *.csv.
  Each type can only be used alternately, not simultaneously.

Example: if you're run the program 18.11.2017 at 17:01 UTC with option: --logfile-esbs ~/data/esbslog it's creates the file 20171118-1701-esbslog.csv in the directory ~/tmp for the current user with content:

2017-11-18,17:01:11,131.550,2,B-7899,,Q0,4,S42A,CA0908,CCA908,1445,781008,China,Boeing,787 9,B789,34311,2016,Air China,SBGR-LEMD-ZBAA,57.397476,80.81955,119.7,39000,505.2,0,
2017-11-18,17:01:15,131.550,2,B-1567,,Q0,7,S63A,MF0812,CXA812,0155,7810A3,China,Boeing,787 9,B789,63041,2016,Xiamen Airlines,,56.98776,82.129802,117.7,38975,509.5,0,
2017-11-18,17:01:21,131.550,2,B-5977,,Q0,8,S82A,CA0962,CCA962,,780DFB,China,Airbus,A330 343E,A333,,2015,,,55.481232,86.931236,122.0,35000,497.8,64,
2017-11-18,17:01:23,131.550,2,B-7899,,Q0,4,S42A,CA0908,CCA908,1445,781008,China,Boeing,787 9,B789,34311,2016,Air China,SBGR-LEMD-ZBAA,57.386759,80.854413,119.6,38975,503.8,0,
2017-11-18,18:31:30,131.725,2,PH-BHH,,H1,0,D28A,KL0867,KLM867,0274,485342,Netherlands,Boeing,787 9,B789,38767,2016,KLM Royal Dutch Airlines,EHAM-RJBB,56.973887,79.600466,112.4,34975,523.3,0,#DFB(POS-KLM867  -5702N07919E/183022 F350  RMK/FUEL  34.1 M0.85)
2017-11-18,18:32:40,131.725,O,F-GSPN,,2F,9,M04A,AF0264,AFR264,3207,3949ED,France,Boeing,777 228ER,B772,29011,2000,Air France,LFPG-RKSI,56.106526,83.145475,115.3,34975,508.6,0,1832+5611+8314/35331

- Changed the file name when you export the console messages to a log file.

- Corrected ICAO and IATA airline codes compliance.

- Code cleanup.

Windows Intel x86: acarsdeco2_windows_20171115.zip https://drive.google.com/open?id=16dQZ7CJC0Io2L9b6z-7A64YHdYWzr31n (Windows 7-10)

Raspberry Pi 2/3 (Broadcom SoC BCM2836/37, quad-core):

Raspbian GNU/Linux 8.0 (Jessie): acarsdeco2_rpi2-3_20171115.tgz https://drive.google.com/open?id=18SzM5Ui6Pbouaz-J1Rfw2IBjAVaS7nYc
Raspbian GNU/Linux 9.0 (Stretch): acarsdeco2_rpi2-3_deb9_20171115.tgz https://drive.google.com/open?id=1afHXuPtu4oajHWQc8QNYa6v59Nn4wwMz

OS X Intel x86: acarsdeco2_osx_20171115.tgz https://drive.google.com/open?id=1Mhwxs_TUILkwZ8uV0KnO9sz0vsSUJ8g0 (El Capitan, Darwin Kernel Version 15.6.0)

Ubuntu 16.04 Intel 64 bit: acarsdeco2_x86_64_20171115.tgz https://drive.google.com/open?id=1M0TElCdYnb2-p5HcbFxv_SXgKhbYB3DW
Ubuntu 16.04 Intel 32 bit: acarsdeco2_i386_20171115.tgz https://drive.google.com/open?id=1zdoPrF3BSDFwMBhOjn5gMmrpuDRbebbx

Best regards,
sergsero


[Attachment deleted by Admin to save file space]

[acarslogger]

Hi sergsero

Thanks for the the new version of AcarsDeco2 (20171115).

Observation 1

I see that the the log file naming has changed.
In the previous version I used the option --logfile C:\Users\....\acarsdeco2\logs\acarsdeco2
and this generated a log file suffixed with date and time. e.g. C:\Users\....\acarsdeco2\logs\acarsdeco2-20171103-123456.log
In this new version the log file is named C:\Users\....\acarsdeco2\logs\20171103-123456-acarsdeco2.log
I prefer the original "name-<date_and_time>.log".
This also applies to the other log file (--logfile) options generated by you new version.

Observation 2
You can generate either the --logfile-sbs or the --logfile-esbs output. Not both. I'm not sure why anyone would want to generate both, so maybe change the readme to clarify.

Possible request.
Could you enhance the program to create a new log file at midnight for those who run 7x24. Then there will be 1 file per day.

I've tried installing on my Raspberry Pi v3 (running Jessie) and get this error when I execute the program ...

Using device:  0 mnf: Realtek prod: RTL2838UHIDIR serial: xxxxxxxxx <<I've replaced my serial number with xxxxxxxxx>>
usb_claim_interface error -6
Error: sdr_open(): Device or resource busy

Searching the internet someone suggested using the following as part of the make process.

cmake ../ -DINSTALL_UDEV_RULES=ON -DDETACH_KERNEL_DRIVER=ON

I'm not a Pi v3 / Linux expert so I've no idea what this means and whether it would enable me to run your program on my Pi v3.

Thanks for your continued support to your excellent program.

Regards
Stuart

[evangel]

hi Stuart

regarding error

Code Select Expand

usb_claim_interface error -6
this is indicative of either
a. your device is in use by another program, or,
b. in /etc/modprobe.d/  there is no "blacklist-rtl28xx.conf", "rtl-sdr-blacklist.conf" file or similar.

fyi you cannot use the device for both acars and ads-b reception. it must be one or the other. 

rgds
evangel

[acarslogger]

Hi evangel

I've read about blacklisting devices, but AcarsDeco2 acts differently to other applications.

This is what I can do ...

I plug in my RTL-SDR (v3) into the Pi 3.
Reboot
I then start an application that uses the RTL-SDR; dumpVDL2.
It starts and decodes VDL2 data.
Reboot Pi.
Without touching the RTL-SDR, I then start another application; acarsdec.
It starts and decodes Acars data.
Reboot Pi
Without touching the RTL-SDR, I then start AcarsDeco2. It fails with the message
usb_claim_interface error -6
Error: sdr_open(): Device or resource busy

So why is acarsdeco2 different to other applications that have no problem starting?

Regards
Stuart

[sergsero]

Hi Stuart,

Thank you for testing the program.

About "Observation 1".
It's only an order of the fragments in the template name and its easy to fix.  Only need to decide on the final version because I have received other requests to change it exactly as it is now.

About "Observation 2".
I agree with you and also decided that a simultaneous export of data in two types only increase the code.

About "Possible request".
I think this should be done in the current version at 00:01 UTC the next day.

Regarding error.
As evangel explained in detail, for which I am very grateful, your issue is due to the device is unavailable for the program. Acarsdeco2 uses its own code to direct work with a dongle and it does not require the presence of third-party libraries as librtlsdr or other.

Please check and make only two things in your Raspberry Pi: 1. deactivate the kernel driver and 2. add permissions to allow users to access the rtl2832.

1. Do you have in the directory /etc/modprobe.d any named file with a .conf extension (for example, it can called "blacklist-rtl28xx.conf") with these contents:

Code Select Expand

blacklist dvb_usb_rtl28xxu
blacklist rtl2832
blacklist rtl2830
for disable using kernel's native driver?

p.s. Once you have created this blacklist file, you may need to unload the driver one last time if it was already running - the blacklist prevents it from loading but doesn't do anything if it's already running. The quickest solution is to simply unload the driver by console command:

Code Select Expand

sudo rmmod dvb_usb_rtl28xxu rtl2832

The solution you found on the Internet (cmake ../ -DINSTALL_UDEV_RULES=ON -DDETACH_KERNEL_DRIVER=ON) is to recompile a programs and include support for asking the kernel driver to let go of the device, so it can be accessed.
This may not be ideal though, because you will still have the problem of the device being in use if you use other programs, in this case acarsdeco2, that do not support detaching of the kernel driver.

2. Because you successfully using other sdr programs, it is likely that in the directory /etc/udev/rules.d/ already contains the file rtl-sdr.rules. For example, if you were building the rtlsdr library from osmocom.org (https://osmocom.org/projects/sdr/wiki/rtl-sdr#Building-the-software).

If not and you've never setup your rtl2832 dongle in raspbian except from root, you'll need to add permissions to allow common users to access the rtl2832:
- download the archive https://github.com/steve-m/librtlsdr/archive/v0.5.3.zip (or https://github.com/steve-m/librtlsdr/archive/v0.5.3.tar.gz) and extract from it the file rtl-sdr.rules,
- copy (as root) the file rtl-sdr.rules to your /etc/udev/rules.d/,
- set file permissions: sudo chmod u=rw,g=r,o=r rtl-sdr.rules
- refresh the udev rules: sudo udevadm control --reload-rules
- re-connect the dongle to the same USB port.

Best regards,
sergsero

[acarslogger]

Hi sergsero & evangel

Thanks for your help.

In my /etc/modprobe.d I had
blacklist-rtl8192cu.conf
blacklist-rtl8xxxu.conf

I changed blacklist-rtl8xxxu.conf to add

blacklist dvb_usb_rtl28xxu
blacklist rtl2832
blacklist rtl2830

After reboot acarsdeco2 started OK. Thanks.

I have 3 of the new RTL-820 v3 each with its own unique serial number. So as an experiment I connected all 3 to the Pi v3, and ensured that the command line parameters of each application was assigned to a separate RTL-820 v3 serial number.
Started all 3 applications and it worked! I now have a Raspberry Pi v3 that can run 3 RTL-820 v3 each running and decoding a different application; acarsdeco2, acarsdeco and dumpvdl2. Amazing what the Pi v3 can do!

From 'top'

Code Select Expand

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
  989 pi        20   0   20084   9824   2904 S  55.7  1.0   8:27.58 dumpvdl2
1148 pi        20   0   40056   5280   1952 S  19.2  0.6   2:57.14 acarsdec
  991 pi        20   0   80888   8320   4964 S  16.0  0.9   2:28.34 acarsdeco2

Again, thanks for your help.
Regards
Stuart

[evangel]

 glad it worked 

[Hobbyd]

Hi Sergsero,
New version is up and running.
Problem with SQ is solved, thank you.

Below are a few new observations:

1.
Below is a SQ message and I think the source shoeld not be AIR but Ground.

SOURCE: AIR
RX_ID: 1345, Freq: 131.725MHz
ACARS mode: e (SITA, G2A) NACK Aircraft reg:       
Message label: SQ Block id: 


Message content:-
02XSGVALSGG04613N00606EV136975/
-------------------------------------------------------[2017-11-21 10:51:29.654]

2.
Regardsless of the mode ~ provider (SITA or ARINC)  the progam always shows (SITA, G2A).
I assume that SITA is meant as the provider name.
Not sure about the 'G2A'...

ACARS mode: G (SITA, G2A) NACK Aircraft reg: G-EUPM
ACARS mode: 2 (SITA, G2A) ACK, A2G Aircraft reg: N824NW

3.
The message contains either 'ACK, A2G' or 'NACK' like the two examples below.
I do understand the ACK and NACK but not the combination with A2G.
ACARS mode: E (SITA, G2A) ACK, A2G Aircraft reg: PH-BXG
ACARS mode: E (SITA, G2A) NACK Aircraft reg: PH-BXG

Cheers,
Dick