Hi, On 07/18/2016 10:59 AM, Luiz Augusto von Dentz wrote: > Hi Alex, > > On Sun, Jul 17, 2016 at 6:52 PM, Alexander Aring <aar@xxxxxxxxxxxxxx> wrote: >> >> Hi, >> >> On 07/14/2016 01:40 PM, Luiz Augusto von Dentz wrote: >>> Hi Alex, >>> >>> On Wed, Jul 13, 2016 at 12:19 AM, Alexander Aring <aar@xxxxxxxxxxxxxx> wrote: >>>> >>>> Hi, >>>> >>>> On 07/11/2016 09:50 PM, Alexander Aring wrote: >>>>> This patch adds a new btle 6lowpan implementation in version 0.2. This >>>>> new implementation has a new userspace API for debugfs. >>>>> >>>>> It's now possible to decide on which hci interface do you want to run >>>>> your 6LoWPAN interface, for that you can run: >>>>> >>>>> echo "hci0 1" > /sys/kernel/debug/bluetooth/6lowpan_enable >>>>> >>>>> to enable, or: >>>>> >>>>> echo "hci0 0" > /sys/kernel/debug/bluetooth/6lowpan_enable >>> >>> No please no more designs for debugfs, we are past that and moving >>> towards having proper management commands, so what you did here is a >>> huge waste of time and you have instead just ask before hand. >>> >> >> The first time when I used BTLE 6LoWPAN I complaint about that I can not >> say "use this special hci%d for lowpan interface xy", I did that not on >> the mailinglist it was on the irc channel and everybody agreed that it >> need to be fixed. The basic idea on my side was to run only one Virtual >> Machine with two BTLE usb dongles to communicate to each other, so I >> needed to switch to two virtual machines to workaround this issue. >> >> If you have the current debugfs UAPI 1:1 already in some kind of stable >> bluetooth API then I would give you the BIG advice to fix that and let >> me look into that. (As far I know there exists idea's only, no >> implementations). > > There is the patches posted by Patrik implementing the management interface: > > http://www.spinics.net/lists/linux-bluetooth/msg66486.html > Okay, just to be sure here, in the above document: Controller ID = hdev(usually var name, struct hci_dev)->id Interface Index = dev(usualy var name, struct net_device)->idx Is this right? I think so, so my next stuff will base on that. > Note that these commands are per interface index, so you would be able > to have two dongle talking to each other, we could in fact even > automate this to test with 2 virtual controllers. > We have similar automating testing in 802.15.4 6LoWPAN with virtual transceiver drivers. I always looked somehow for some virtual driver in bluetooth, does this exist mainline? >> Another really BIG thing is (it comes to the direction "breaking UAPI" >> as well) that the interface depends on if Slaves are connected. So if >> the last Slave will be disconnected then the interface will be deregistered. >> Every IPv6 userspace application cannot deal with that. The interface >> lifetime must not depend on if slaves connected or not. > > This is tricky because the even using privacy the address of the > interface is defined by the time the connection is established, but > perhaps there is a way to set this properly on the network interface, > anyway I do agree the making the interface persistent is probably much > more convenient. > This is currently something which I don't understand. With "privacy" you mean the LE_PUBLIC and LE_PRIVATE address, the address type? I think, we don't need that when we doing an interface register. This is currently one of the big issue which this RFC fixes, the 8 byte vs 6 bytes address. At Interface register we need to know the source address only, which is my opinion the hdev->bdaddr. This address has (in my opinion) nothing todo with the address type. I can argument here with rfc7668: "This means that no bit in the IID indicates whether the underlying Bluetooth device address is public or random." The IID is for autoconfiguration the last 8 bytes of IPv6 address and usually generated by "dev->dev_addr" (dev = struct net_device). Also the "dev->dev_addr" will be used in address options for NS/NA/RS/RA... In the current implementation the IID generation is mixed with the "dev->addr" (dev as struct net_device) field which is wrong. In summary: We don't need to know to wait for connection to setting the "dev->dev_addr" (struct net_device). This field should be "hdev->bdaddr" and hdev should be the hdev which is bounded to the dev(lowpan struct net_device). I see no issues to create interfaces before, except you saying that "hdev->bdaddr" is unknown. >> At this case, I think every netdev people would agree. >> >>>>> to disable it. A cat on this file will show the current hci <-> 6lowpan >>>>> interface mapping. >>>>> >>>>> Additional the different is, that the interface will be created after >>>>> enable it. The old behaviour is that the interface will be created when >>>>> one first connection is established and deleted after all connections >>>>> (peers) will be disconnected. This handling is different now. >>>>> >>>>> The reason (in my opinion) is that the existing of such interface should >>>>> not based on if there is a connection or not. At runtime of many IPv6 >>>>> application an interface will be removed -> I think the most userspace >>>>> application can and will never handle that an IPv6 interface will be >>>>> deleted and recreating during runtime. >>>>> >>>>> The new handling is that the interface will not removed and you can >>>>> re-establish the connection to your peers. >>>>> >>>>> Connection to peers: >>>>> >>>>> Connection to peers are not binded to hci interface, it's binded to your >>>>> 6LoWPAN interface. This will prepare handling for multiple 6LoWPAN >>>>> interfaces on one hci (maybe also with netns support, which isn't >>>>> available yet) and you can choose which peers should be handled by >>>>> different BTLE 6LoWPAN interfaces. Example: >>>>> >>>>> L2: hci0 is connected to node A, B, C, D >>>>> >>>>> L3: 6lo0 and 6lo1 are two interfaces based on hci0. >>>>> 6lo0 is connected to nodes: A, B, C >>>>> 6lo1 is connected to nodes: D, C, B >>> >>> Is this is useful for what exactly? I much rather have a simple module >>> that just deal with 1 connection than have to deal with complex >>> topology in the beginning, so this is moving in the exact opposite >>> direction. >>> >> >> Well, I learned now to not talking about crazy use-cases which you could >> do with that. I need more to talk about why this is really needed. I >> will do that in future. > > It is about priorities, we should concentrate in making it work for > simpler cases, besides the RFC don't talk about subnets either. > I don't talking about subnets. I am talking about "make the connect command per interface". Patrik works shows the following: Add Network Command =================== Command Code: 0x0043 Controller Index: <controller id> Command Parameters: Address (6 Octets) Address_Type (1 Octet) Return Parameters: Address (6 Octets) Address_Type (1 Octet) Interface Index (4 Octets) This command is used to connect to establish a network connection to a remote BTLE node. A pre-requisite is that LE is supported by the controller, otherwise this command will return a "not supported" response. Possible values for the Address_Type parameter: 0 Reserved 1 LE Public 2 LE Random This command generates a Command Complete event on success or failure. Possible errors: Busy Refused Invalid Parameters Not Supported Invalid Index Already Connected So far I understand, this is "make the connect command per device", the device in this case is not a "struct net_device" it's "struct hci_dev". In the "possible" future case to having multiple interfaces you cannot say on which interface this connect should be done. With "connect" I mean the l2cap_chan_connect call. btw: Also I don't know what's now the parameters "Address/Address_Type" source/destination? Is the Input of them equal to the output? > >> I observed, what I explained above. There exists two "connect" mechanism, >> these are L2 and L3. >> >> With L2 I mean $FIND_OUT_RIGHT_NOT_DEPRECATED_TOOL_IN_BT_UTILITY_DSCHUNGEL >> leadv/lecc stuff. This prepares somehow that you can say >> l2cap_chan_connect in the upper-layer to connect to slaves. >> >> With l2cap_chan_connect I mean L3 connection, which is the same like >> what you doing in L2 for L3. It's also not be a MUST, because you can >> run e.g. above example Node A, B, C, D on L2 and: >> >> BTLE 6LoWPAN: A <-> B >> >> L2CAP_SOCK: C <-> D >> >> or some other mixed scenario. I think you want to still have such behaviour. >> This would be the same like: A, B, C, D and 6lo0 is connected to A, B. >> Forget the C, D, make with them whatever you want (_maybe_ namespace with >> C, D or l2cap_sock). > > Im not sure where you are going with l2cap_sock here, yes we can make > it connect to different peers but usually each peer assumes a role in > BLE, the central role scans and connect and the peripheral only > advertise. If you do have more than one controller it should be fine > to have multiple network interfaces and then perhaps you can bridge > them together, or not, but this should be controlled via userspace, > the kernel shall only manage the network interface. > Yes, but the kernel needs an UAPI so the user can control it over userspace. See above my "make connect per interface" suggestion. >> At least if you want to have netns support with mutliple lowpan then >> there will nothing to complex, it's just the same interface handling >> like having one interface in init_net namespace. Just you can deal with >> different namespaces with that (UAPI need to support namespaces for that). >> >> It makes completely more sense to say to "lowpan interface 6lo%d connect >> to slave xy". >> >> The current way is that the user has no control of it and >> l2cap_chan_connect call this "hci_get_route" function behind and with >> bluetooth magic the user get one hci interface which best-fits and maybe >> not that what you want. > > See http://www.spinics.net/lists/linux-bluetooth/msg66495.html, it > takes the index of the interface upfront so you can specify which > adapter to use so it shouldn't rely on hci_get_route anymore. > See above, make the "connect per hci device" will make it not clear if having multiple interfaces on one hci dev. >>>>> To connect to peers, there exists no "6lowpan_control" anymore. The >>>>> control file is now peer interface, it's simple: >>>>> >>>>> echo "connect $PEER_ADDRESS 1" > /sys/kernel/debug/bluetooth/6lo0 >>>>> >>>>> Also after connecting to peers it's still possible that another peer can >>>>> to connect to the peer which has already a connected peer (complicated >>>>> to describe). I saw that is somehow disabled in version before, see: >>>>> >>>>> http://lxr.free-electrons.com/source/net/bluetooth/6lowpan.c#L1247 >>>>> >>>>> I am not a bluetooth expert, but I guess that is somehow if there exists >>>>> limitation to devices which are not "peers" that means devices which can >>>>> be run as master or slave only. So far I know such limitations for >>>>> devices doesn't exists for BTLE 6LoWPAN, or? >>>>> >>> >>> I guess that is because dual role is not specified, you either are a >>> node or a router but not both at the same time. >>> >> >> Okay, then I will close the "listen" l2cap channel after somebody did a >> connect. But I bet there was some graphic somewhere which had a >> >> SLAVE.... <---- MASTER <----> MASTER ----> SLAVE... >> >> So with that we forbid such MASTER <-> MASTER connections. > > This master to master connection doesn't make much sense, usually a > central cannot connect to another central since none advertise > anything, but indeed we can have more than one slave/none connected to > a master/router. Note we can in fact switch between peripheral and > central roles, so in theory it is still possible to have subnets, but > it is just very unlikely. > I rechecked that handling and I think closing that "listen" channel will not forbid such MASTER <-> MASTER stuff. I previous mentioned that I found in the current mainline implementation that the listen channel will be closed somehow when running a "connect", I still get no the reason why. I thought it's something that you cannot "accept other connection" when running a "connect" command once. But if I had the "listen" channel before running and already accept connection and running "connect" afterwards, then I still have the channels open which was accepted by the "listen" channel. In short: I need to know somehow what's possible. When running connect and when doing the "listen" stuff for accepting incoming connection. We talking here about l2cap layer. Can it not be it's such simple that l2cap_chan_connect/etc. functionality will drop an error if it's simple not possible? Then we let the subsystem decide if such connections are possible or not. Depends on what means the RFC and if we need to make more than the bluetooth subsystem can handle. Then it would be the question to map these errors to UAPI. I am really confused about the closing "listen" stuff channel. :-/ >>>> I think the following will explain somehow when it's a SLAVE and when >>>> MASTER as my current view. >>>> >>>> SLAVES: >>>> >>>> They don't makes this echo "connect ..." foo in control files. >>>> they only do "hciconfig hci0 leadv" that somebody other can connect to >>>> that node (some MASTER node). >>>> >>>> MASTERS: >>>> >>>> can do the same what the SLAVES does but to be as MASTER they need to call >>>> additional stuff: >>>> >>>> hcitool lecc $SLAVE_ADDR (one or more times) >>> >>> Don't use hcitool, actually never mention any of hci related >>> interfaces on the patches there are deprecated, btmgmt shall be used >>> to enable things like advertising, I will be working on adding >>> advertising support for bluetoothctl but we actually need IPSP UUID >>> support in order to make this work properly so not even btmgmt will be >>> enough in the end. >>> >> >> Yes, Marcel already told me some tools are deprecated and I should not >> use them. You don't want to know how long I took when I had some working >> setup with my broadcom dongles. :-) >> >> I am too lazy to switch, I will use now btmgmt. I hope it can do the >> same suff up/down (I think power on/off) and leadv and lecc. > > Yes, but if we keep using those people will never learn there deprecated. > I didn't know it either, is there some wiki webpage which says about which tool is deprecated and which isn't? >> >>>> Additional for different lowpan interfaces (don't need the same addresses >>>> which was used by previous one or more hcitool lecc calls): >>>> >>>> echo "connect SLAVE_ADDR 1" > /sys/kernel/debug/bluetooth/6lo0 >>>> >>>> is this a correct view and can all BTLE transceivers run as SLAVE or >>>> MASTER, or exists there some special transceivers outside which can be >>>> run as SLAVE only? >>>> >>>>> Nevertheless I disabled that stuff, it's still possible to connect to >>>>> some node which already run "connect ..." on his side. >>>>> >>>>> Otherwise I fixed the ndisc stuff and removed a lot of races/side >>>>> effects. The old code had some static "lowpan_devices" list and most >>>>> time there was some lookup mapping according to bdaddr to get the right >>>>> 6lo netdevice struct. I removed that, also the skb->cb is used a lot in >>>>> some callback which had some side-effects. >>> >>> Send the fixes, and the fixes only. >>> >> >> There exists fixes only, no new features. In my opinion, UAPI is broken >> because you can't control what you want. Again, because "hci_get_route" magic. >> I added no new features, I fixed the broken things. Maybe there are some >> little small cleanups if you say changing function namens is not a >> bugfix it's a cleanup. > > See the RFC sent by Patrik, the MGMT commands use interface index so > hci_get_route should not be needed. > See above, I would suggest to make some commands per interface and not per hci_dev. >> Removing the whole implementation and adding a new one is the only way >> which I would think it is possible, because we need to fix stuff in >> IPHC and as well in IPv6 as well. > > I guess these are separate fixes aren't they? Or are they depending on > this patch? > yea, some of them. I will make a clearer version of the patch series and send some patches mainline which I can do before. The necessary stuff for btle 6lowpan begins at: - Remove bluetooth implementation and ends at: - Add new bluetooth implementation Patches between of them will changes something in different Layers, this is IPHC and IPv6. This is mostly to change the stuff from 8 bytes address to 6 byte address. If I would do it before, I would break the btle 6lowpan stuff before. Besides that there are many races etc in btle 6lowpan so I just do a remove, prepare handling for 6 byte address and add a new implementation. I didn't hit a race yet but I need to test more with some unlikely testcases. The only issue which I get while using 6lowpan is the "tx_credits" deadlock, which we need to talk about more. The current mainline implementation is very unstable on my side, means: my kernel will crash. >> I know the zephyr people wants to be backwardscompatible I could say, I >> add a big BROKEN_IMPLEMENTATION Kconfig switch which let's you compile >> the old broken version which is still compatible with stacks outside. > > No, in fact we need these fixes in order to work properly with zephyr. > Did you test this patch series with zephyr, or somebody else? >> btw: stacks outside I see currently pull-request in RIOT-OS which do the >> same L2 address length is 8 instead 6, which means they are currently >> bug compatible with Linux. > > Sounds like a bug there, Bluetooth shall use MAC addresses of 6 bytes > long the conversion for 8 bytes (64 bits) is just for the link local > to form the so called IID (https://tools.ietf.org/html/rfc7668) I > don't think it should be transmitted with 0xff, 0xfe encoded in the > address. > This bug I mentioned earlier, see: http://www.spinics.net/lists/linux-wpan/msg03899.html Besides that another big bug is that BTLE ignores the neighbour discovery cache. Only addresses which are generated by autoconfiguration. Normally the ndisc cache has L3 -> L2 address mapping (but includes more than just that). The mainline work stuff do currently to reconstruct the L2 address from L3 address, which only for autoconfiguration addresses. In short: If you set an own ipv6 address which is not based on mac address it will not work. Also some other IPv6 mechanism in neighbour discovery will not work. This patch series will fix that and use the neighbour discovery. btw: I report that bug 3-4 months ago in irc channel. IMPORTANT NOTE: This means not that we using ARO DAC/DAR stuff from rfc6775. --- At last I would like suggest some ideas for the UAPI handling, which is some oriented (for interface generation) what we have in 802.15.4: 1. Command to add an 6lowpan interface according to hci dev (You can add multiple interfaces then if calling more than once) 2. Command to del an 6lowpan interface 3. Command to connect to $PEER (or $SLAVE, whatever the right term is here), but this command is per 6lowpan interface. Not hci_dev. 4. Command to disconnect to $PEER, per 6lowpan interface as well. Maybe I we should make the UAPI more clear and I implement it for now as debugfs. But you think it's waste of time, or isn't it? I also detected that debugfs doesn't like to remove debugfs while debugfs handling. So the second command is complicated to implement. (I did some workqueue workaround for that which I mentioned many times inside the comments that it is a workaround). btw: Some kernel hackers would also say thet doing the xmit workqueue is a workaround because we need to use "async API". I don't saw any xmit async functionality at bluetooth subsystem and I also need to hold the l2cap chan->lock when I call l2cap_chan_send, so this is a mutex and I need to run a workqueue. I try to deal with that in the current implementation, so far it works... but running a workqueue to call l2cap_chan_send which runs again a workqueue is bad. - Alex -- To unsubscribe from this list: send the line "unsubscribe linux-wpan" in the body of a message to majordomo@xxxxxxxxxxxxxxx More majordomo info at http://vger.kernel.org/majordomo-info.html
